Posts tagged "databricks"

Diagram of a single Unity Catalog ABAC policy masking the pii:email column across three tables, including one created next quarter

Databricks Unity Catalog ABAC: Attribute-Based Access Control

How ABAC in Databricks Unity Catalog governs row filters and column masks by tag instead of by table, how to wire it up, and when it's overkill.

databricks unity-catalog data-governance

Mory Kaba6 Jul 2026 · 13 min read

Diagram showing the Databricks system catalog with its five schemas: billing, access, lakeflow, compute, and query

Databricks Unity Catalog System Tables: Cost, Audit & Lineage SQL Queries

Unity Catalog system tables expose billing, audit, lineage, and compute data for your entire Databricks account as plain SQL - here's how to use them.

databricks unity-catalog data-engineering

Mory Kaba10 Jun 2026 · 11 min read

Line chart showing a Spark Structured Streaming pipeline degrading over time, then recovering after a fix

How to Fix Degrading Spark Structured Streaming Jobs in Databricks

Small files, growing state, slowing batches: why Spark Structured Streaming pipelines degrade over time and how to fix them.

databricks spark-streaming data-engineering

Mory Kaba22 May 2026 · 13 min read