Bruin CLI Step 2 of 4

Shopify to ClickHouse with Bruin

1) Map the raw layer

T1 is the raw Shopify layer. It keeps source-shaped records in shopify.t1_* tables and gives every asset a clear grain, source, data classification, and incremental policy.

AssetDestination tableWhat it ingestsIncremental cursor
t1_customers.asset.ymlshopify.t1_customersCustomer profiles, consent state, lifetime totals, and addressesupdated_at
t1_products.asset.ymlshopify.t1_productsProduct catalogue and variant structuresupdated_at
t1_orders.asset.ymlshopify.t1_ordersOrder headers plus serialized lines, refunds, fulfilments, and addressesupdated_at
t1_inventory_items.asset.ymlshopify.t1_inventory_itemsSKUs, costs, inventory levels, and variantsupdated_at
t1_discounts.asset.ymlshopify.t1_discountsDiscount definitions and their Shopify metadataupdated_at
t1_events.asset.ymlshopify.t1_eventsShopify audit events about actions and changed resourcescreated_at

The raw tables are useful for debugging source behaviour, but they are not the preferred place for business queries. Orders and products retain nested Shopify structures as serialized values. The next layer makes those fields usable for analytics.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.