Amazon SQS integration
Amazon SQS data, in your warehouse.
A built-in ingestr connector: add credentials, pick tables, schedule it.
name: raw.table
type: ingestr
parameters:
source_connection: amazon_sqs
source_table: '<table>'
destination: snowflake
incremental_strategy: merge$ bruin run assets/raw/amazon_sqs.asset.yml
- extract · Amazon SQS dataincremental
- load · snowflake raw.datamerged
- checks · not_null, unique
Loaded and checked. Downstream models can run.
How it connects
Connected in three steps.
Amazon Simple Queue Service is a managed message queue for decoupling applications and moving messages between services.
- 01
Add a Amazon SQS connection with its credentials.
- 02
Pick the tables to load and how: replace, append or merge.
- 03
Bruin runs it on your schedule and checks every load.
Connection parameters
- sessiontoken
- Optional AWS session token. You can also use awssessiontoken.
- region
- AWS region for the queue. You can also use regionname or awsregion.
- endpointurl
- Optional custom endpoint, useful for LocalStack.
- visibilitytimeout
- Optional message visibility timeout in seconds while ingestr buffers records. Defaults to 300.
- waittimeseconds
- Optional SQS long-poll wait time. Defaults to 2.
The platform
Part of the Bruin platform.
Data in, ready for everything downstream: the models, the checks, the lineage and the AI layer.
01 · Move
02 · Model & govern
03 · Use
Streams & queues
More tools, same category.
Frequently asked
Questions about Amazon SQS.
Does Bruin have a built-in Amazon SQS integration?
Yes. Built-in ingestr source.
Where can Amazon SQS data go?
Snowflake, BigQuery, Databricks, Redshift, ClickHouse, Postgres, DuckDB, MotherDuck, Microsoft Fabric and more, plus files on S3 and GCS.
How fresh is the data?
As fresh as your schedule. Incremental loads append, merge or replace a time window, every few minutes if you like.
Do we need Bruin Cloud?
No. The Bruin CLI and ingestr run locally, in CI or in your own orchestrator. Bruin Cloud adds scheduling, lineage, alerts and the AI data analyst on top.
Ready to connect Amazon SQS?
$100 in credits and 50 AI tasks. No credit card.
A demo walks through your own data.