Bruin Academy

Guide

Shopify to ClickHouse with Bruin

Initialize the Shopify to ClickHouse template, configure its connections, and understand every ingestion, modelling, and reporting asset it creates.

Skip ahead

The whole project is one command. Run it, point your coding agent at the Bruin MCP, and it can configure and run everything itself.

$ bruin init shopify-clickhouse

Three ways to go from here:

  • Self-service it. Let the agent configure and run the whole thing, and ask it questions as you go.
  • Follow this tutorial. Slower, and it explains why each setting matters - the part an agent will not guess for you.
  • Hand the tutorial to the agent. Point it at this page and have it work through the steps with you.

The template README is the short reference for everything it ships.

What

Build a Shopify analytics pipeline in ClickHouse without starting from empty YAML files. The template ingests customers, products, orders, inventory items, discounts, and audit events; turns them into conformed commerce models; and creates daily revenue, KPI, reconciliation, cohort, and product-performance marts.

How

Run bruin init shopify-clickhouse, add Shopify and ClickHouse connections, then inspect the three layers the template creates. You will see how ingestr assets handle incremental Shopify extraction, how ClickHouse SQL models form a dependency graph, and how checks keep revenue and product metrics honest before you schedule a daily run.

Before you start

  • Bruin CLI installed
  • A Shopify custom app with an Admin API access token and the scopes for the resources you plan to ingest
  • A ClickHouse database and credentials with permission to create and update tables

Guide overview

Start Guide
  1. 1Initialize and Connect the TemplateCreate the project, add Shopify and ClickHouse connections, and read the pipeline-wide configuration.
  2. 2Ingest the Shopify Raw LayerUnderstand every T1 ingestr asset, its incremental policy, data contract, and source metadata.
  3. 3Model Conformed Commerce DataWalk through the five T2 ClickHouse SQL assets, their dependency order, contracts, and commerce logic.
  4. 4Build and Verify Analytics MartsRead the five T3 marts, validate the graph, backfill safely, and verify the ClickHouse results.

Resources

Shopify to ClickHouse template READMEShopify ingestion referenceClickHouse connection and asset referenceBruin validate command

Get help & contribute

Join Slack GitHub Docs

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.

The signup form is hosted by Brevo. Accept cookies to load it.