Global Energy Transition Pipeline
This pipeline ingests, transforms, and analyses 125 years of global energy data (1900–2026) across 200+ countries to track the worldwide transition from fossil fuels to renewables. The project uncovered surprising stories like Denmark jumping from 15% to 91% renewable electricity since 2000, DR Congo and Ethiopia already running on 100% renewable power. The pipeline is built entirely with Bruin on DuckDB, with an interactive Evidence.dev dashboard for visualization and GitHub Actions for CI/CD. Bruin Features Used: - Seed assets: ingested the OWID(Our World in Data) CSV dataset directly into DuckDB - SQL assets: built 4 mart tables (global trends, country trends, renewables leaderboard, Africa energy spotlight) - Data quality checks: 54 automated checks across all assets — column-level (not_null, non_negative) and custom SQL checks - bruin ai enhance: AI-powered documentation, column descriptions, domain tags, and data-driven quality checks on all mart assets - pipeline.yml orchestration: daily schedule with dependency management - bruin lineage: full DAG visualisation of asset dependencies - bruin validate: integrated into GitHub Actions CI/CD workflow