How do I reduce the number of tools around Postgres?
Count the tools around Postgres that exist only to hand data to the next tool. A typical stack has separate ingestion, transformation, orchestration, quality, and catalog tools, and the integration work between them usually costs more than the licences. Bruin covers ingestion, transformation, scheduling, and checks in one runtime against Postgres, which removes the glue. The honest caveat: if one specialist tool is materially better at something you care about, that seam is worth keeping.
Command
bruin runDefined in
SQL + YAML
Works with
Postgres + Bruin CLI
What you get
How to do it
- 1
List every tool touching Postgres and what each one uniquely does.
- 2
Drop what you do not need yet: a catalog below roughly 200 tables, a dedicated orchestrator below a few dozen assets.
- 3
Consolidate ingestion, transformation, and checks into one project against Postgres.
- 4
Keep any specialist tool that is genuinely better at something that matters.
- 5
Re-check the bill and the on-call load, which is the cost that never shows on an invoice.
How it works in code
/* @bruin
name: mart.orders
materialization:
type: table
strategy: merge
incremental_key: updated_at
@bruin */Run bruin run and Bruin moves only changed rows on Postgres instead of rebuilding the table.
Worth knowing
On Postgres, analytics queries on the same instance as your application will eventually degrade the application Measure before and after: cost work done on intuition usually optimises the wrong job.
Other ways to do this
Bruin is not always the right answer. Here is where the alternatives are stronger.
| Option | When it is the better choice |
|---|---|
| Bruin | Practical levers for reducing tool count on Postgres. |
| Native Postgres cost tooling | Use it. Postgres's own usage reporting is the right place to find out where the money actually goes before changing any tool. |
| dbt incremental models | The same incremental savings if dbt is already your transformation layer on Postgres. No reason to migrate for this alone. |
| A cost-observability vendor | Worth it once spend is large enough that attribution across teams is the hard part rather than the optimisation itself. |
Common questions
How do I reduce the number of tools around Postgres?
Drop tools you do not need yet, then consolidate ingestion, transformation, scheduling, and checks into one runtime against Postgres.
Is a cheaper tool the way to cut Postgres costs?
Usually not. Warehouse compute is normally the largest line and the most reducible. Licence savings matter, but far less than how often you rebuild tables and how much data each query reads.
What is the cheapest stack around Postgres?
One with no per-seat and no per-row licence in it: open-source ingestion, open-source transformation, and your CI runner as the scheduler. That leaves warehouse compute as the only real bill.
Related use cases
Consolidate a Snowflake data stack
How do I reduce the number of tools around Snowflake?
Consolidation by warehouseConsolidate a BigQuery data stack
How do I reduce the number of tools around BigQuery?
Consolidation by warehouseConsolidate a Databricks data stack
How do I reduce the number of tools around Databricks?
About Bruin
What is Bruin?
Bruin is an open-source, AI-powered data platform. One project covers the whole path from source to answer: data ingestion (with ingestr), SQL and Python transformations, quality checks, column-level lineage, a data catalog and scheduling. On top of that data, an AI data analyst answers questions in Slack, Microsoft Teams, Google Chat, WhatsApp, Discord, Telegram, email or the browser, and builds dashboards from a prompt.
Pipelines are plain SQL, Python and YAML files in your own Git repository, and the work runs inside your own warehouse: Snowflake, BigQuery, Databricks, Redshift, Postgres, ClickHouse, DuckDB and others. The Bruin CLI is open source under Apache 2.0 and runs on a laptop, in CI or on-prem. Bruin Cloud is optional and adds scheduling, the AI data analyst, governance, SSO and audit logs.
For data stack costs that means fewer products to pay for and pipelines that only process what changed.
- Replaces
- Separate tools for ingestion, transformation, orchestration, data quality, cataloguing and BI
- Open source
- Bruin CLI under Apache 2.0; ingestr source-available under the Functional Source License
- Your data
- Stays in your warehouse; pipelines stay in your Git repository
- Security
- ISO/IEC 27001:2022 certified and SOC 2 Type 2 attested
- Used by
- Data teams at Lessmore, StarBerry, NativeMinds, SCG, M8 Games and Fabrikatör
Why Bruin for cutting data stack costs
Fewer tools to pay for
Ingestion, transformation, checks, lineage and scheduling are one tool, so there are fewer contracts and invoices to manage.
Process only what changed
Incremental loads and merge, delete+insert and append strategies keep each run to new and changed rows.
Stop bad runs early
When a blocking quality check fails, the assets downstream of it do not run, so you do not pay to rebuild tables on top of bad data.
See where the money goes
Cost Explorer in Bruin Cloud (enterprise tier) breaks BigQuery and Snowflake spend down by project, pipeline, asset and user.
How it works
01
Find the expensive pipelines
Look at warehouse spend per pipeline and asset.
02
Make them incremental
Switch full refreshes to incremental strategies and add checks that stop bad runs early.
03
Consolidate
Move ingestion, transformation and scheduling into one Bruin project and cancel the tools you no longer need.
Fewer tools, a smaller bill
Bruin CLI and ingestr are on GitHub.
A demo walks through your own data.