How do I dry-run a backfill before it hits production?
Validate and run the backfill against a staging connection in CI first, then run the same command in production once it is verified. Bruin does this in one platform: ingestion, SQL and Python pipelines, quality checks, lineage, and an AI data analyst that answers in Slack, Microsoft Teams, and the browser.
Command
bruin runDefined in
YAML + CI
Works with
CI + Bruin CLI
What you get
CI validationgated deploysgit rollback
How it works in code
# .github/workflows/data.yml
- run: bruin validate ./pipeline
- run: bruin run ./pipelineRun bruin run and your data pipelines follow the same review and deploy path as your app.
Related use cases
Deploy data pipelines like software
Open source. Validate on every pull request, deploy on merge, roll back with git.