Posts tagged "databricks"

Diagram of a single Unity Catalog ABAC policy masking the pii:email column across three tables, including one created next quarter

databricks unity-catalog data-governance abac access-control data-engineering

Databricks Unity Catalog ABAC: Attribute-Based Access Control

How ABAC in Databricks Unity Catalog governs row filters and column masks by tag instead of by table, how to wire it up, and when it's overkill.

Mory Kaba6 Jul 2026 · 13 min read

Diagram showing the Databricks system catalog with its five schemas: billing, access, lakeflow, compute, and query

databricks unity-catalog data-engineering finops sql cost-optimization

Databricks Unity Catalog System Tables: Cost, Audit & Lineage SQL Queries

Unity Catalog system tables expose billing, audit, lineage, and compute data for your entire Databricks account as plain SQL - here's how to use them.

Mory Kaba10 Jun 2026 · 11 min read

Line chart showing a Spark Structured Streaming pipeline degrading over time, then recovering after a fix

databricks spark-streaming data-engineering performance delta-lake

How to Fix Degrading Spark Structured Streaming Jobs in Databricks

Small files, growing state, slowing batches: why Spark Structured Streaming pipelines degrade over time and how to fix them.

Mory Kaba22 May 2026 · 13 min read