ingestr recipes/Incremental loads by warehouseData Engineer

How do I replace a partition when loading into Athena with ingestr?

Point ingestr at a Athena destination URI and pass the delete+insert strategy to replace a partition. ingestr handles the schema and the incremental logic, so there is no custom merge code for Athena.

Command

ingestr ingest

Defined in

CLI

Works with

Athena + ingestr

What you get

delete+insert strategyauto schemaone command

How it works in code

$ ingestr ingest \
  --source-uri $SRC \
  --dest-uri athena://... \
  --incremental-strategy delete+insert

Run ingestr ingest and ingestr applies the delete+insert strategy into Athena on every run.

Move data with one command

Open source. Source URI in, destination URI out, incremental by default.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.