Lineage/Lineage by warehouseData Platform Engineer

A Databricks metric looks wrong. Where did it go bad?

Walk the Databricks column lineage upstream from the metric to inspect each transformation and narrow down where the value diverged.

Command

bruin lineage

Defined in

SQL + YAML

Works with

Databricks + Bruin CLI

What you get

Debuggingemergentcolumn-level

How it works in code

$ bruin lineage ./pipeline --downstream  # databricks

Run bruin lineage and you see the full Databricks column graph before changing anything.

Know what a change will break

Open source. Emergent column-level lineage across SQL and Python assets.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.