Alibaba MaxCompute integration

Alibaba MaxCompute data, in your warehouse.

A built-in ingestr connector: add credentials, pick tables, schedule it.

name: raw.table
type: ingestr
parameters:
  source_connection: alibaba_maxcompute
  source_table: '<table>'
  destination: snowflake
  incremental_strategy: merge

$ bruin run assets/raw/alibaba_maxcompute.asset.yml

  1. extract · Alibaba MaxCompute dataincremental
  2. load · snowflake raw.datamerged
  3. checks · not_null, unique

Loaded and checked. Downstream models can run.

How it connects

Connected in three steps.

MaxCompute is Alibaba Cloud's distributed data processing and warehousing platform. ingestr supports MaxCompute as both a source and destination. The odps URI scheme is also accepted.

  1. 01

    Add a Alibaba MaxCompute connection with its credentials.

  2. 02

    Pick the tables to load and how: replace, append or merge.

  3. 03

    Bruin runs it on your schedule and checks every load.

Connection parameters

accessid
Alibaba Cloud access key ID. It can also be supplied with ALIBABACLOUDACCESSKEYID or ODPSACCESSID.
accesskey
Alibaba Cloud access key secret. It can also be supplied with ALIBABACLOUDACCESSKEYSECRET or ODPSACCESSKEY.
host
MaxCompute endpoint host. If endpoint is supplied, this can be any non-empty placeholder host.
project
MaxCompute project name. This can be supplied in the URI path or as project.

Every way Alibaba MaxCompute works with Bruin

  • SourceBuilt-in ingestr sourceDocs →
  • DestinationBuilt-in ingestr destinationDocs →

The platform

Part of the Bruin platform.

Data in, ready for everything downstream: the models, the checks, the lineage and the AI layer.

01 · Move

Data Ingestion

02 · Model & govern

SQL & Python
Data Quality
Data Governance

03 · Use

AI Data Analyst
AI Dashboards
Data Apps
Self-Healing Pipelines
Bruin Cloudorchestration · governance · observability

Frequently asked

Questions about Alibaba MaxCompute.

Does Bruin have a built-in Alibaba MaxCompute integration?

Yes. Built-in ingestr source. Built-in ingestr destination.

Where can Alibaba MaxCompute data go?

Snowflake, BigQuery, Databricks, Redshift, ClickHouse, Postgres, DuckDB, MotherDuck, Microsoft Fabric and more, plus files on S3 and GCS.

How fresh is the data?

As fresh as your schedule. Incremental loads append, merge or replace a time window, every few minutes if you like.

Do we need Bruin Cloud?

No. The Bruin CLI and ingestr run locally, in CI or in your own orchestrator. Bruin Cloud adds scheduling, lineage, alerts and the AI data analyst on top.

Ready to connect Alibaba MaxCompute?

$100 in credits and 50 AI tasks. No credit card.

A demo walks through your own data.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.

The signup form is hosted by Brevo. Allow marketing cookies to load it.