ingestr recipes/Incremental loads by warehouseData Engineer

How do I replace a partition when loading into BigQuery with ingestr?

Point ingestr at a BigQuery destination URI and pass the delete+insert strategy to replace a partition. ingestr handles the schema and the incremental logic, so there is no custom merge code for BigQuery.

Command

ingestr ingest

Defined in

CLI

Works with

BigQuery + ingestr

What you get

delete+insert strategyauto schemaone command

How it works in code

$ ingestr ingest \
  --source-uri $SRC \
  --dest-uri bigquery://... \
  --incremental-strategy delete+insert

Run ingestr ingest and ingestr applies the delete+insert strategy into BigQuery on every run.

Move data with one command

Open source. Source URI in, destination URI out, incremental by default.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.