Bruin CLI Step 2 of 6

Stripe Analytics Pipeline with BigQuery

Guide overview
  1. Set Up Your Environment4 min
  2. 2Run the Ingestion Layer3 min
  3. 3Run the Staging Layer4 min
  4. 4Run the Reports Layer3 min
  5. 5Serve the Dashboard Locally3 min
  6. 6Extend It With an Agent4 min
PreviousSet Up Your EnvironmentNextRun the Staging Layer

1) Run the raw layer

Bruin's selector syntax lets you run one directory of assets at a time:

bruin run --selector "path:assets/stripe_raw" --full-refresh --no-validation

Two flags matter on this first run:

  • --full-refresh creates the tables from scratch. Use it on the initial load only.
  • --no-validation skips the query dry-run. The downstream models reference tables that do not exist yet, so validating the whole pipeline before the first load will fail for the wrong reason. You run full validation in Step 4.

Warning

Do not keep --full-refresh in your daily schedule. Later in this pipeline it would wipe the daily MRR snapshot tables, and those observations cannot be reconstructed from current Stripe data.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.

The signup form is hosted by Brevo. Accept cookies to load it.