Use Cases · For data engineers
Transformation and orchestration
Build SQL and Python pipelines as code with the Bruin CLI. Declare dependencies, materializations, and schedules in YAML, and run the whole graph with one command.
Orchestration by warehouse
40 use casesOrchestrate a pipeline on Snowflake without Airflow
How do I orchestrate a Snowflake pipeline without a separate scheduler?
Backfill a Snowflake pipeline for a date range
How do I backfill historical partitions on Snowflake?
Run incremental models on Snowflake in dependency order
How do I run only the affected Snowflake models after a change?
Schedule a Snowflake pipeline to run daily
How do I schedule a Snowflake pipeline on a cadence?
Orchestrate a pipeline on BigQuery without Airflow
How do I orchestrate a BigQuery pipeline without a separate scheduler?
Backfill a BigQuery pipeline for a date range
How do I backfill historical partitions on BigQuery?
Run incremental models on BigQuery in dependency order
How do I run only the affected BigQuery models after a change?
Schedule a BigQuery pipeline to run daily
How do I schedule a BigQuery pipeline on a cadence?
Orchestrate a pipeline on Postgres without Airflow
How do I orchestrate a Postgres pipeline without a separate scheduler?
Backfill a Postgres pipeline for a date range
How do I backfill historical partitions on Postgres?
Run incremental models on Postgres in dependency order
How do I run only the affected Postgres models after a change?
Schedule a Postgres pipeline to run daily
How do I schedule a Postgres pipeline on a cadence?
Orchestrate a pipeline on Databricks without Airflow
How do I orchestrate a Databricks pipeline without a separate scheduler?
Backfill a Databricks pipeline for a date range
How do I backfill historical partitions on Databricks?
Run incremental models on Databricks in dependency order
How do I run only the affected Databricks models after a change?
Schedule a Databricks pipeline to run daily
How do I schedule a Databricks pipeline on a cadence?
Orchestrate a pipeline on Redshift without Airflow
How do I orchestrate a Redshift pipeline without a separate scheduler?
Backfill a Redshift pipeline for a date range
How do I backfill historical partitions on Redshift?
Run incremental models on Redshift in dependency order
How do I run only the affected Redshift models after a change?
Schedule a Redshift pipeline to run daily
How do I schedule a Redshift pipeline on a cadence?
Orchestrate a pipeline on DuckDB without Airflow
How do I orchestrate a DuckDB pipeline without a separate scheduler?
Backfill a DuckDB pipeline for a date range
How do I backfill historical partitions on DuckDB?
Run incremental models on DuckDB in dependency order
How do I run only the affected DuckDB models after a change?
Schedule a DuckDB pipeline to run daily
How do I schedule a DuckDB pipeline on a cadence?
Orchestrate a pipeline on MotherDuck without Airflow
How do I orchestrate a MotherDuck pipeline without a separate scheduler?
Backfill a MotherDuck pipeline for a date range
How do I backfill historical partitions on MotherDuck?
Run incremental models on MotherDuck in dependency order
How do I run only the affected MotherDuck models after a change?
Schedule a MotherDuck pipeline to run daily
How do I schedule a MotherDuck pipeline on a cadence?
Orchestrate a pipeline on ClickHouse without Airflow
How do I orchestrate a ClickHouse pipeline without a separate scheduler?
Backfill a ClickHouse pipeline for a date range
How do I backfill historical partitions on ClickHouse?
Run incremental models on ClickHouse in dependency order
How do I run only the affected ClickHouse models after a change?
Schedule a ClickHouse pipeline to run daily
How do I schedule a ClickHouse pipeline on a cadence?
Orchestrate a pipeline on MySQL without Airflow
How do I orchestrate a MySQL pipeline without a separate scheduler?
Backfill a MySQL pipeline for a date range
How do I backfill historical partitions on MySQL?
Run incremental models on MySQL in dependency order
How do I run only the affected MySQL models after a change?
Schedule a MySQL pipeline to run daily
How do I schedule a MySQL pipeline on a cadence?
Orchestrate a pipeline on Athena without Airflow
How do I orchestrate a Athena pipeline without a separate scheduler?
Backfill a Athena pipeline for a date range
How do I backfill historical partitions on Athena?
Run incremental models on Athena in dependency order
How do I run only the affected Athena models after a change?
Schedule a Athena pipeline to run daily
How do I schedule a Athena pipeline on a cadence?
SQL and Python pipelines
24 use casesBuild a SQL + Python pipeline on Snowflake
How do I run SQL and Python transformations together on Snowflake?
Materialize a table incrementally on Snowflake
How do I run incremental models on Snowflake without hand-writing merge logic?
Build a SQL + Python pipeline on BigQuery
How do I run SQL and Python transformations together on BigQuery?
Materialize a table incrementally on BigQuery
How do I run incremental models on BigQuery without hand-writing merge logic?
Build a SQL + Python pipeline on Postgres
How do I run SQL and Python transformations together on Postgres?
Materialize a table incrementally on Postgres
How do I run incremental models on Postgres without hand-writing merge logic?
Build a SQL + Python pipeline on Databricks
How do I run SQL and Python transformations together on Databricks?
Materialize a table incrementally on Databricks
How do I run incremental models on Databricks without hand-writing merge logic?
Build a SQL + Python pipeline on Redshift
How do I run SQL and Python transformations together on Redshift?
Materialize a table incrementally on Redshift
How do I run incremental models on Redshift without hand-writing merge logic?
Build a SQL + Python pipeline on DuckDB
How do I run SQL and Python transformations together on DuckDB?
Materialize a table incrementally on DuckDB
How do I run incremental models on DuckDB without hand-writing merge logic?
Build a SQL + Python pipeline on MotherDuck
How do I run SQL and Python transformations together on MotherDuck?
Materialize a table incrementally on MotherDuck
How do I run incremental models on MotherDuck without hand-writing merge logic?
Build a SQL + Python pipeline on ClickHouse
How do I run SQL and Python transformations together on ClickHouse?
Materialize a table incrementally on ClickHouse
How do I run incremental models on ClickHouse without hand-writing merge logic?
Build a SQL + Python pipeline on MySQL
How do I run SQL and Python transformations together on MySQL?
Materialize a table incrementally on MySQL
How do I run incremental models on MySQL without hand-writing merge logic?
Build a SQL + Python pipeline on Athena
How do I run SQL and Python transformations together on Athena?
Materialize a table incrementally on Athena
How do I run incremental models on Athena without hand-writing merge logic?
Build a SQL + Python pipeline on Synapse
How do I run SQL and Python transformations together on Synapse?
Materialize a table incrementally on Synapse
How do I run incremental models on Synapse without hand-writing merge logic?
Build a SQL + Python pipeline on Microsoft Fabric
How do I run SQL and Python transformations together on Microsoft Fabric?
Materialize a table incrementally on Microsoft Fabric
How do I run incremental models on Microsoft Fabric without hand-writing merge logic?
Orchestration and scheduling
8 use casesOrchestrate a pipeline without Airflow
Can I orchestrate SQL and Python steps without standing up Airflow?
Schedule a pipeline to run daily
How do I schedule a Bruin pipeline to run on a cadence?
Define dependencies between assets
How do I declare that one model depends on another?
Run only what changed
Can I run just the models affected by my change?
Backfill a pipeline for a date range
How do I backfill historical partitions for a model?
Mix SQL, Python and shell steps in one pipeline
Can a single pipeline contain SQL, Python and a shell step?
Run the same pipeline across dev and prod
How do I run one pipeline against multiple environments?
Validate a pipeline before running it
Can I check a pipeline for errors before it touches the warehouse?
Python in pipelines
4 use casesRun a Python transformation as a first-class asset
Can Python models be first-class citizens next to SQL?
Score an ML model inside a pipeline
How do I run model scoring as part of a data pipeline?
Call an external API and land the result
Can a pipeline step call an API and store the response?
Share a Python environment across assets
How do I manage Python dependencies for pipeline steps?
SQL and Python, one pipeline
Open source. Define assets, declare dependencies, run the graph with bruin run.