How do I run and validate BigQuery pipelines from GitLab CI?
Call bruin validate and bruin run in a GitLab CI job against BigQuery. Connections come from CI secrets, and a failing check blocks the merge before bad data lands in BigQuery.
Command
bruin runDefined in
YAML + CI
Works with
GitLab CI + BigQuery
What you get
CI validationgated deployssecret-managed connections
How it works in code
# gitlab job
- run: bruin validate ./pipeline
- run: bruin run ./pipeline # bigqueryRun bruin run and the BigQuery pipeline runs on merge or on schedule from GitLab CI.
Related use cases
Run pipelines in GitLab CI
Run Snowflake pipelines in GitLab CI
How do I run and validate Snowflake pipelines from GitLab CI?
Run pipelines in GitLab CIRun Postgres pipelines in GitLab CI
How do I run and validate Postgres pipelines from GitLab CI?
Run pipelines in GitLab CIRun Databricks pipelines in GitLab CI
How do I run and validate Databricks pipelines from GitLab CI?
Ship data pipelines like software
Open source. Validate in CI, gate on checks, deploy on merge, roll back with git.