How do I run ingestion as a step in my pipeline?
Call ingestr from a Bruin asset so ingestion and transformation live in the same pipeline, with dependencies and scheduling handled together.
Command
ingestr ingestDefined in
CLI
Works with
any source and destination
What you get
Open sourceone commandincrementalpipeline-native
How it works in code
$ ingestr ingest --source-uri $SRC --dest-uri $DSTRun ingestr ingest and the load runs from the CLI, no platform to operate.
Related use cases
ingestr recipes and comparisons
Use ingestr as an open-source alternative to Fivetran
Is there an open-source, command-line alternative to Fivetran?
ingestr recipes and comparisonsUse ingestr as an alternative to Airbyte
Can I replace an Airbyte deployment with something simpler?
ingestr recipes and comparisonsReplace a Sling script with ingestr
How does ingestr compare to Sling for moving data?
Move data with one command
Open source. Source URI in, destination URI out, incremental by default.