Transformation/Orchestration by warehouseData Engineer

How do I backfill historical partitions on Databricks?

Run the pipeline with a start and end date and Bruin executes each partition against Databricks, so backfills are one command instead of a script.

Command

bruin run

Defined in

SQL + Python + YAML

Works with

Databricks + Bruin CLI

What you get

Partitioned backfillsone commandwarehouse-native

How it works in code

$ bruin run --start-date 2026-01-01 ./pipeline  # databricks

Run bruin run and Bruin runs the graph against Databricks in dependency order.

SQL and Python, one pipeline

Open source. Define assets, declare dependencies, run the graph with bruin run.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.