Lineage/Lineage by warehouseData Platform Engineer

Which Databricks columns are never used downstream?

Lineage shows Databricks columns with no downstream consumers, so you can safely deprecate them and shrink your models.

Command

bruin lineage

Defined in

SQL + YAML

Works with

Databricks + Bruin CLI

What you get

Dead-column detectionemergentcolumn-level

How it works in code

$ bruin lineage ./pipeline --downstream  # databricks

Run bruin lineage and you see the full Databricks column graph before changing anything.

Know what a change will break

Open source. Emergent column-level lineage across SQL and Python assets.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.