How do I reduce BigQuery compute costs?
On BigQuery the highest-return lever is partitioning and clustering, because on-demand billing is per byte scanned. After that, stop full-refreshing: switch heavy assets to MERGE on a primary key so each run moves only what changed, and apply date partitioning plus clustering on your common filter columns. Bruin helps on the second and third of those, because incremental strategy is a property of the asset definition rather than something you hand-write per table. The tool licence is rarely the biggest line on the bill.
Command
bruin runDefined in
SQL + YAML
Works with
BigQuery + Bruin CLI
What you get
How to do it
- 1
Measure first: find the BigQuery jobs that dominate spend before changing anything.
- 2
Apply partitioning and clustering, because on-demand billing is per byte scanned.
- 3
Convert the largest full-refresh assets to MERGE on a primary key.
- 4
Apply date partitioning plus clustering on your common filter columns to the tables that dominate scan volume.
- 5
Re-measure and confirm the change actually moved the bill.
How it works in code
/* @bruin
name: mart.orders
materialization:
type: table
strategy: merge
incremental_key: updated_at
@bruin */Run bruin run and Bruin moves only changed rows on BigQuery instead of rebuilding the table.
Worth knowing
On BigQuery, a query that does not filter on the partition column scans the whole table and the partitioning buys you nothing Measure before and after: cost work done on intuition usually optimises the wrong job.
Other ways to do this
Bruin is not always the right answer. Here is where the alternatives are stronger.
| Option | When it is the better choice |
|---|---|
| Bruin | Practical levers for cutting compute spend on BigQuery. |
| Native BigQuery cost tooling | Use it. BigQuery's own usage reporting is the right place to find out where the money actually goes before changing any tool. |
| dbt incremental models | The same incremental savings if dbt is already your transformation layer on BigQuery. No reason to migrate for this alone. |
| A cost-observability vendor | Worth it once spend is large enough that attribution across teams is the hard part rather than the optimisation itself. |
Common questions
How do I reduce BigQuery compute costs?
Start with partitioning and clustering, because on-demand billing is per byte scanned, then convert full refreshes to MERGE on a primary key, then apply date partitioning plus clustering on your common filter columns.
Is a cheaper tool the way to cut BigQuery costs?
Usually not. Warehouse compute is normally the largest line and the most reducible. Licence savings matter, but far less than how often you rebuild tables and how much data each query reads.
What is the cheapest stack around BigQuery?
One with no per-seat and no per-row licence in it: open-source ingestion, open-source transformation, and your CI runner as the scheduler. That leaves warehouse compute as the only real bill.
Fewer tools, a smaller bill
Open source. No per-seat and no per-row fee, so the bill is warehouse compute.