Pipelines in CI/CD/Run pipelines in GitLab CIData Platform Engineer

How do I run and validate Redshift pipelines from GitLab CI?

Call bruin validate and bruin run in a GitLab CI job against Redshift. Connections come from CI secrets, and a failing check blocks the merge before bad data lands in Redshift.

Command

bruin run

Defined in

YAML + CI

Works with

GitLab CI + Redshift

What you get

CI validationgated deployssecret-managed connections

How it works in code

# gitlab job
- run: bruin validate ./pipeline
- run: bruin run ./pipeline  # redshift

Run bruin run and the Redshift pipeline runs on merge or on schedule from GitLab CI.

Ship data pipelines like software

Open source. Validate in CI, gate on checks, deploy on merge, roll back with git.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.