Pipelines in CI/Run pipelines in GitHub ActionsData Platform Engineer

How do I run and validate Athena pipelines from GitHub Actions?

Call bruin validate and bruin run in a GitHub Actions job against Athena. Connections come from CI secrets, and a failing check blocks the merge before bad data lands in Athena. Bruin does this in one platform: ingestion, SQL and Python pipelines, quality checks, lineage, and an AI data analyst that answers in Slack, Microsoft Teams, and the browser.

Command

bruin run

Defined in

YAML + CI

Works with

GitHub Actions + Athena

What you get

CI validationgated deployssecret-managed connections

How it works in code

# github job
- run: bruin validate ./pipeline
- run: bruin run ./pipeline  # athena

Run bruin run and the Athena pipeline runs on merge or on schedule from GitHub Actions.

Deploy data pipelines like software

Open source. Validate on every pull request, deploy on merge, roll back with git.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.

The signup form is hosted by Brevo. Allow marketing cookies to load it.