Guide
Shopify to ClickHouse with Bruin
Initialize the Shopify to ClickHouse template, configure its connections, and understand every ingestion, modelling, and reporting asset it creates.
What
Build a Shopify analytics pipeline in ClickHouse without starting from empty YAML files. The template ingests customers, products, orders, inventory items, discounts, and audit events; turns them into conformed commerce models; and creates daily revenue, KPI, reconciliation, cohort, and product-performance marts.
How
Run bruin init shopify-clickhouse, add Shopify and ClickHouse connections, then inspect the three layers the template creates. You will see how ingestr assets handle incremental Shopify extraction, how ClickHouse SQL models form a dependency graph, and how checks keep revenue and product metrics honest before you schedule a daily run.
Before you start
- Bruin CLI installed
- A Shopify custom app with an Admin API access token and the scopes for the resources you plan to ingest
- A ClickHouse database and credentials with permission to create and update tables
Guide overview
- 1Initialize and Connect the TemplateCreate the project, add Shopify and ClickHouse connections, and read the pipeline-wide configuration.
- 2Ingest the Shopify Raw LayerUnderstand every T1 ingestr asset, its incremental policy, data contract, and source metadata.
- 3Model Conformed Commerce DataWalk through the five T2 ClickHouse SQL assets, their dependency order, contracts, and commerce logic.
- 4Build and Verify Analytics MartsRead the five T3 marts, validate the graph, backfill safely, and verify the ClickHouse results.
Resources
Get help & contribute