How do I keep full history when loading into ClickHouse with ingestr?
Point ingestr at a ClickHouse destination URI and pass the scd2 strategy to keep full history. ingestr handles the schema and the incremental logic, so there is no custom merge code for ClickHouse.
Command
ingestr ingestDefined in
CLI
Works with
ClickHouse + ingestr
What you get
scd2 strategyauto schemaone command
How it works in code
$ ingestr ingest \
--source-uri $SRC \
--dest-uri clickhouse://... \
--incremental-strategy scd2Run ingestr ingest and ingestr applies the scd2 strategy into ClickHouse on every run.
Related use cases
Incremental loads by warehouse
Load into Snowflake with the merge strategy
How do I upsert changed rows when loading into Snowflake with ingestr?
Incremental loads by warehouseLoad into Snowflake with the append strategy
How do I append new rows when loading into Snowflake with ingestr?
Incremental loads by warehouseLoad into Snowflake with the delete+insert strategy
How do I replace a partition when loading into Snowflake with ingestr?
Move data with one command
Open source. Source URI in, destination URI out, incremental by default.