How do I run and validate Athena pipelines from GitLab CI?
Call bruin validate and bruin run in a GitLab CI job against Athena. Connections come from CI secrets, and a failing check blocks the merge before bad data lands in Athena.
Command
bruin runDefined in
YAML + CI
Works with
GitLab CI + Athena
What you get
CI validationgated deployssecret-managed connections
How it works in code
# gitlab job
- run: bruin validate ./pipeline
- run: bruin run ./pipeline # athenaRun bruin run and the Athena pipeline runs on merge or on schedule from GitLab CI.
Related use cases
Run pipelines in GitLab CI
Run Snowflake pipelines in GitLab CI
How do I run and validate Snowflake pipelines from GitLab CI?
Run pipelines in GitLab CIRun BigQuery pipelines in GitLab CI
How do I run and validate BigQuery pipelines from GitLab CI?
Run pipelines in GitLab CIRun Postgres pipelines in GitLab CI
How do I run and validate Postgres pipelines from GitLab CI?
Ship data pipelines like software
Open source. Validate in CI, gate on checks, deploy on merge, roll back with git.