Migrate to Bruin/Migrate from DagsterData Engineer

How do I move my Dagster workflow to Bruin on Databricks?

Point Bruin at your Databricks connection and bring your Dagster logic across as Bruin assets. Ingestion, transformation, quality, and lineage then run against Databricks from one CLI.

Command

bruin run

Defined in

SQL + Python + YAML

Works with

Dagster + Databricks + Bruin

What you get

Consolidated stackwarehouse-nativeCLI-first

How it works in code

$ bruin run ./pipeline  # against databricks

Run bruin run and your whole workflow runs against Databricks from one tool.

One CLI instead of five tools

Open source. Ingest, transform, test, and trace lineage in a single workflow.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.