ingestr recipes/Incremental loading strategiesData Engineer

How do I append only new rows with ingestr?

Pass the append strategy to ingestr to add only new rows. One flag changes how the data lands, with no custom merge code to write.

Command

ingestr ingest

Defined in

CLI

Works with

Any ingestr source and destination

What you get

Incremental strategiesone flagno merge code

How it works in code

$ ingestr ingest \
  --source-uri $SRC --dest-uri $DST \
  --incremental-strategy append

Run ingestr ingest and ingestr applies the append strategy on every run.

Move data with one command

Open source. Source URI in, destination URI out, incremental by default.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.