Pipelines in CI/CD/Pipelines in CI/CDData Engineer

How do I dry-run a backfill before it hits production?

Validate and run the backfill against a staging connection in CI first, then run the same command in production once it is verified.

Get Bruin on GitHubHow the CLI works

Command

bruin run

Defined in

YAML + CI

Works with

CI + Bruin CLI

What you get

CI validationgated deploysgit rollback

How it works in code

# .github/workflows/data.yml
- run: bruin validate ./pipeline
- run: bruin run ./pipeline

Run bruin run and your data pipelines follow the same review and deploy path as your app.

Related use cases

Pipelines in CI/CD

Run data pipelines in GitHub Actions

How do I run Bruin pipelines from GitHub Actions?

Pipelines in CI/CD

Run data pipelines in GitLab CI

How do I run Bruin pipelines from GitLab CI?

Pipelines in CI/CD

Validate pipelines on every pull request

How do I catch pipeline errors before merge?

Ship data pipelines like software

Open source. Validate in CI, gate on checks, deploy on merge, roll back with git.

Get Bruin on GitHubBook a demo

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.