Use Cases · For data engineers
Warehouse pipelines
Build, schedule, and check an end-to-end pipeline on your warehouse. Ingestion, SQL and Python transformations, and quality checks are assets in one dependency graph.
End-to-end pipelines
12 use casesBuild an end-to-end data pipeline on Snowflake
How do I build an end-to-end data pipeline on Snowflake?
Build an end-to-end data pipeline on BigQuery
How do I build an end-to-end data pipeline on BigQuery?
Build an end-to-end data pipeline on Databricks
How do I build an end-to-end data pipeline on Databricks?
Build an end-to-end data pipeline on Postgres
How do I build an end-to-end data pipeline on Postgres?
Build an end-to-end data pipeline on Redshift
How do I build an end-to-end data pipeline on Redshift?
Build an end-to-end data pipeline on ClickHouse
How do I build an end-to-end data pipeline on ClickHouse?
Build an end-to-end data pipeline on DuckDB
How do I build an end-to-end data pipeline on DuckDB?
Build an end-to-end data pipeline on MotherDuck
How do I build an end-to-end data pipeline on MotherDuck?
Build an end-to-end data pipeline on MySQL
How do I build an end-to-end data pipeline on MySQL?
Build an end-to-end data pipeline on Athena
How do I build an end-to-end data pipeline on Athena?
Build an end-to-end data pipeline on Synapse
How do I build an end-to-end data pipeline on Synapse?
Build an end-to-end data pipeline on Microsoft Fabric
How do I build an end-to-end data pipeline on Microsoft Fabric?
SQL and Python together
12 use casesLoad data into Snowflake with SQL and Python
How do I load data into Snowflake using both SQL and Python?
Load data into BigQuery with SQL and Python
How do I load data into BigQuery using both SQL and Python?
Load data into Databricks with SQL and Python
How do I load data into Databricks using both SQL and Python?
Load data into Postgres with SQL and Python
How do I load data into Postgres using both SQL and Python?
Load data into Redshift with SQL and Python
How do I load data into Redshift using both SQL and Python?
Load data into ClickHouse with SQL and Python
How do I load data into ClickHouse using both SQL and Python?
Load data into DuckDB with SQL and Python
How do I load data into DuckDB using both SQL and Python?
Load data into MotherDuck with SQL and Python
How do I load data into MotherDuck using both SQL and Python?
Load data into MySQL with SQL and Python
How do I load data into MySQL using both SQL and Python?
Load data into Athena with SQL and Python
How do I load data into Athena using both SQL and Python?
Load data into Synapse with SQL and Python
How do I load data into Synapse using both SQL and Python?
Load data into Microsoft Fabric with SQL and Python
How do I load data into Microsoft Fabric using both SQL and Python?
Incremental modelling
12 use casesBuild incremental models on Snowflake
How do I build incremental models on Snowflake instead of full refreshes?
Build incremental models on BigQuery
How do I build incremental models on BigQuery instead of full refreshes?
Build incremental models on Databricks
How do I build incremental models on Databricks instead of full refreshes?
Build incremental models on Postgres
How do I build incremental models on Postgres instead of full refreshes?
Build incremental models on Redshift
How do I build incremental models on Redshift instead of full refreshes?
Build incremental models on ClickHouse
How do I build incremental models on ClickHouse instead of full refreshes?
Build incremental models on DuckDB
How do I build incremental models on DuckDB instead of full refreshes?
Build incremental models on MotherDuck
How do I build incremental models on MotherDuck instead of full refreshes?
Build incremental models on MySQL
How do I build incremental models on MySQL instead of full refreshes?
Build incremental models on Athena
How do I build incremental models on Athena instead of full refreshes?
Build incremental models on Synapse
How do I build incremental models on Synapse instead of full refreshes?
Build incremental models on Microsoft Fabric
How do I build incremental models on Microsoft Fabric instead of full refreshes?
Getting started
12 use casesSet up analytics on Snowflake from scratch
How do I set up a modern data warehouse on Snowflake quickly?
Set up analytics on BigQuery from scratch
How do I set up a modern data warehouse on BigQuery quickly?
Set up analytics on Databricks from scratch
How do I set up a modern data warehouse on Databricks quickly?
Set up analytics on Postgres from scratch
How do I set up a modern data warehouse on Postgres quickly?
Set up analytics on Redshift from scratch
How do I set up a modern data warehouse on Redshift quickly?
Set up analytics on ClickHouse from scratch
How do I set up a modern data warehouse on ClickHouse quickly?
Set up analytics on DuckDB from scratch
How do I set up a modern data warehouse on DuckDB quickly?
Set up analytics on MotherDuck from scratch
How do I set up a modern data warehouse on MotherDuck quickly?
Set up analytics on MySQL from scratch
How do I set up a modern data warehouse on MySQL quickly?
Set up analytics on Athena from scratch
How do I set up a modern data warehouse on Athena quickly?
Set up analytics on Synapse from scratch
How do I set up a modern data warehouse on Synapse quickly?
Set up analytics on Microsoft Fabric from scratch
How do I set up a modern data warehouse on Microsoft Fabric quickly?
Cost efficiency
12 use casesBuild cost-efficient pipelines on Snowflake
How do I build cost-efficient data pipelines on Snowflake?
Build cost-efficient pipelines on BigQuery
How do I build cost-efficient data pipelines on BigQuery?
Build cost-efficient pipelines on Databricks
How do I build cost-efficient data pipelines on Databricks?
Build cost-efficient pipelines on Postgres
How do I build cost-efficient data pipelines on Postgres?
Build cost-efficient pipelines on Redshift
How do I build cost-efficient data pipelines on Redshift?
Build cost-efficient pipelines on ClickHouse
How do I build cost-efficient data pipelines on ClickHouse?
Build cost-efficient pipelines on DuckDB
How do I build cost-efficient data pipelines on DuckDB?
Build cost-efficient pipelines on MotherDuck
How do I build cost-efficient data pipelines on MotherDuck?
Build cost-efficient pipelines on MySQL
How do I build cost-efficient data pipelines on MySQL?
Build cost-efficient pipelines on Athena
How do I build cost-efficient data pipelines on Athena?
Build cost-efficient pipelines on Synapse
How do I build cost-efficient data pipelines on Synapse?
Build cost-efficient pipelines on Microsoft Fabric
How do I build cost-efficient data pipelines on Microsoft Fabric?
Scheduling
12 use casesSchedule Snowflake pipelines without Airflow
How do I schedule and orchestrate Snowflake pipelines without running Airflow?
Schedule BigQuery pipelines without Airflow
How do I schedule and orchestrate BigQuery pipelines without running Airflow?
Schedule Databricks pipelines without Airflow
How do I schedule and orchestrate Databricks pipelines without running Airflow?
Schedule Postgres pipelines without Airflow
How do I schedule and orchestrate Postgres pipelines without running Airflow?
Schedule Redshift pipelines without Airflow
How do I schedule and orchestrate Redshift pipelines without running Airflow?
Schedule ClickHouse pipelines without Airflow
How do I schedule and orchestrate ClickHouse pipelines without running Airflow?
Schedule DuckDB pipelines without Airflow
How do I schedule and orchestrate DuckDB pipelines without running Airflow?
Schedule MotherDuck pipelines without Airflow
How do I schedule and orchestrate MotherDuck pipelines without running Airflow?
Schedule MySQL pipelines without Airflow
How do I schedule and orchestrate MySQL pipelines without running Airflow?
Schedule Athena pipelines without Airflow
How do I schedule and orchestrate Athena pipelines without running Airflow?
Schedule Synapse pipelines without Airflow
How do I schedule and orchestrate Synapse pipelines without running Airflow?
Schedule Microsoft Fabric pipelines without Airflow
How do I schedule and orchestrate Microsoft Fabric pipelines without running Airflow?
Replication
12 use casesReplicate a production database into Snowflake
How do I replicate a production database into Snowflake?
Replicate a production database into BigQuery
How do I replicate a production database into BigQuery?
Replicate a production database into Databricks
How do I replicate a production database into Databricks?
Replicate a production database into Postgres
How do I replicate a production database into Postgres?
Replicate a production database into Redshift
How do I replicate a production database into Redshift?
Replicate a production database into ClickHouse
How do I replicate a production database into ClickHouse?
Replicate a production database into DuckDB
How do I replicate a production database into DuckDB?
Replicate a production database into MotherDuck
How do I replicate a production database into MotherDuck?
Replicate a production database into MySQL
How do I replicate a production database into MySQL?
Replicate a production database into Athena
How do I replicate a production database into Athena?
Replicate a production database into Synapse
How do I replicate a production database into Synapse?
Replicate a production database into Microsoft Fabric
How do I replicate a production database into Microsoft Fabric?
API ingestion
12 use casesBuild an ELT pipeline from an API into Snowflake
How do I build an ELT pipeline from an API into Snowflake?
Build an ELT pipeline from an API into BigQuery
How do I build an ELT pipeline from an API into BigQuery?
Build an ELT pipeline from an API into Databricks
How do I build an ELT pipeline from an API into Databricks?
Build an ELT pipeline from an API into Postgres
How do I build an ELT pipeline from an API into Postgres?
Build an ELT pipeline from an API into Redshift
How do I build an ELT pipeline from an API into Redshift?
Build an ELT pipeline from an API into ClickHouse
How do I build an ELT pipeline from an API into ClickHouse?
Build an ELT pipeline from an API into DuckDB
How do I build an ELT pipeline from an API into DuckDB?
Build an ELT pipeline from an API into MotherDuck
How do I build an ELT pipeline from an API into MotherDuck?
Build an ELT pipeline from an API into MySQL
How do I build an ELT pipeline from an API into MySQL?
Build an ELT pipeline from an API into Athena
How do I build an ELT pipeline from an API into Athena?
Build an ELT pipeline from an API into Synapse
How do I build an ELT pipeline from an API into Synapse?
Build an ELT pipeline from an API into Microsoft Fabric
How do I build an ELT pipeline from an API into Microsoft Fabric?
Modelling
12 use casesModel raw Snowflake tables into marts
How do I model raw tables into clean marts on Snowflake?
Model raw BigQuery tables into marts
How do I model raw tables into clean marts on BigQuery?
Model raw Databricks tables into marts
How do I model raw tables into clean marts on Databricks?
Model raw Postgres tables into marts
How do I model raw tables into clean marts on Postgres?
Model raw Redshift tables into marts
How do I model raw tables into clean marts on Redshift?
Model raw ClickHouse tables into marts
How do I model raw tables into clean marts on ClickHouse?
Model raw DuckDB tables into marts
How do I model raw tables into clean marts on DuckDB?
Model raw MotherDuck tables into marts
How do I model raw tables into clean marts on MotherDuck?
Model raw MySQL tables into marts
How do I model raw tables into clean marts on MySQL?
Model raw Athena tables into marts
How do I model raw tables into clean marts on Athena?
Model raw Synapse tables into marts
How do I model raw tables into clean marts on Synapse?
Model raw Microsoft Fabric tables into marts
How do I model raw tables into clean marts on Microsoft Fabric?
Python transformations
12 use casesRun Python transformations on Snowflake
How do I run Python transformations against Snowflake?
Run Python transformations on BigQuery
How do I run Python transformations against BigQuery?
Run Python transformations on Databricks
How do I run Python transformations against Databricks?
Run Python transformations on Postgres
How do I run Python transformations against Postgres?
Run Python transformations on Redshift
How do I run Python transformations against Redshift?
Run Python transformations on ClickHouse
How do I run Python transformations against ClickHouse?
Run Python transformations on DuckDB
How do I run Python transformations against DuckDB?
Run Python transformations on MotherDuck
How do I run Python transformations against MotherDuck?
Run Python transformations on MySQL
How do I run Python transformations against MySQL?
Run Python transformations on Athena
How do I run Python transformations against Athena?
Run Python transformations on Synapse
How do I run Python transformations against Synapse?
Run Python transformations on Microsoft Fabric
How do I run Python transformations against Microsoft Fabric?
AI context
12 use casesBuild a context layer on Snowflake for AI agents
How do I give AI agents context about my Snowflake data?
Build a context layer on BigQuery for AI agents
How do I give AI agents context about my BigQuery data?
Build a context layer on Databricks for AI agents
How do I give AI agents context about my Databricks data?
Build a context layer on Postgres for AI agents
How do I give AI agents context about my Postgres data?
Build a context layer on Redshift for AI agents
How do I give AI agents context about my Redshift data?
Build a context layer on ClickHouse for AI agents
How do I give AI agents context about my ClickHouse data?
Build a context layer on DuckDB for AI agents
How do I give AI agents context about my DuckDB data?
Build a context layer on MotherDuck for AI agents
How do I give AI agents context about my MotherDuck data?
Build a context layer on MySQL for AI agents
How do I give AI agents context about my MySQL data?
Build a context layer on Athena for AI agents
How do I give AI agents context about my Athena data?
Build a context layer on Synapse for AI agents
How do I give AI agents context about my Synapse data?
Build a context layer on Microsoft Fabric for AI agents
How do I give AI agents context about my Microsoft Fabric data?
Migration
12 use casesMigrate a legacy ETL job to Snowflake
How do I migrate a legacy ETL job onto Snowflake?
Migrate a legacy ETL job to BigQuery
How do I migrate a legacy ETL job onto BigQuery?
Migrate a legacy ETL job to Databricks
How do I migrate a legacy ETL job onto Databricks?
Migrate a legacy ETL job to Postgres
How do I migrate a legacy ETL job onto Postgres?
Migrate a legacy ETL job to Redshift
How do I migrate a legacy ETL job onto Redshift?
Migrate a legacy ETL job to ClickHouse
How do I migrate a legacy ETL job onto ClickHouse?
Migrate a legacy ETL job to DuckDB
How do I migrate a legacy ETL job onto DuckDB?
Migrate a legacy ETL job to MotherDuck
How do I migrate a legacy ETL job onto MotherDuck?
Migrate a legacy ETL job to MySQL
How do I migrate a legacy ETL job onto MySQL?
Migrate a legacy ETL job to Athena
How do I migrate a legacy ETL job onto Athena?
Migrate a legacy ETL job to Synapse
How do I migrate a legacy ETL job onto Synapse?
Migrate a legacy ETL job to Microsoft Fabric
How do I migrate a legacy ETL job onto Microsoft Fabric?
One pipeline, end to end
Open source. Ingestion, SQL and Python transformations, and checks in one graph.