All integrations
Microsoft SQL Server
+
Bruin

Microsoft SQL Server + Bruin

SourceDestination

Ingest data from Microsoft SQL Server or push enriched data back, with quality checks, lineage, and scheduling. Defined in YAML, version-controlled in Git.

For business teams

What you get

  • Real-time warehouse sync

    Microsoft SQL Server tables replicate to your warehouse continuously. Analytics teams work with fresh data, not yesterday's export.

  • Catch issues at the source

    Quality checks validate Microsoft SQL Server data as it replicates. Null IDs, duplicate records, and schema drift get caught early.

  • Multi-source joins

    Combine Microsoft SQL Server with SaaS data, APIs, and other databases in your warehouse. One Bruin pipeline handles it all.

  • No untracked scripts

    Replication is defined in YAML, reviewed in PRs, and deployed with CI/CD. No more mystery cron jobs.

For data & engineering teams

How it works

  • CDC with merge strategy

    Bruin handles change data capture from Microsoft SQL Server with deduplication. Schema changes are detected and handled automatically.

  • YAML-defined, Git-versioned

    Your Microsoft SQL Server replication is a YAML file. Review in PRs, deploy with CI/CD. No more untracked database scripts.

  • Row-level quality checks

    Validate primary keys, foreign keys, and referential integrity on every sync. Catch corruption at the source.

  • Multi-source pipelines

    Combine Microsoft SQL Server with SaaS APIs and other databases in one pipeline. Bruin resolves cross-source dependencies.

Before you start

SQL Server instance running
SQL Server Authentication or Windows Authentication configured
TCP/IP protocol enabled in SQL Server Configuration Manager
Firewall rules for port 1433

Step 1

Add your Microsoft SQL Server connection

SQL Server connection format. Add this to your Bruin environment file, credentials are stored securely and referenced by name in your pipeline YAML.

Parameters

  • usernameSQL Server login
  • passwordLogin password
  • hostServer name or IP
  • portPort number (default 1433)
  • databaseDatabase name
  • encryptUse encryption (true/false)
  • trustServerCertificateTrust certificate
connections:
  microsoftsqlserver:
    type: microsoftsqlserver
    uri: "mssql://username:password@host:port/database"

Step 2

Create your pipeline

Define a YAML asset that tells Bruin what to pull from Microsoft SQL Server and where to land it. This file lives in your Git repo, reviewable, version-controlled, and deployable with CI/CD.

Available tables

dbo.CustomersSales.OrdersProduction.Products
name: raw.microsoftsqlserver_dbo.Customers
type: ingestr

parameters:
  source_connection: microsoftsqlserver
  source_table: 'dbo.Customers'
  destination: bigquery

Step 3

Add quality checks

Add column-level and custom SQL checks to your Microsoft SQL Server data. If a check fails, the pipeline stops, bad data never reaches downstream models or dashboards.

Validate row counts are within expected range
Ensure primary keys are unique and not null
Catch schema drift with freshness checks
columns:
  - name: id
    checks:
      - name: not_null
      - name: unique
  - name: created_at
    checks:
      - name: not_null

custom_checks:
  - name: row count within expected range
    query: |
      SELECT COUNT(*) BETWEEN 1 AND 10000000
      FROM raw.microsoftsqlserver_dbo.Customers

Step 4

Run it

One command. Bruin connects to Microsoft SQL Server, pulls data incrementally, runs your quality checks, and lands clean data in your warehouse. If a check fails, the pipeline stops, bad data never reaches downstream.

Backfill historical data with --start-date
Schedule with cron or trigger from CI/CD
Full lineage from Microsoft SQL Server to your dashboards 
$ bruin run .
Running pipeline...

  microsoftsqlserver_dbo.Customers
    ✓ Fetched 2,847 new records
    ✓ Quality: campaign_id not_null     PASSED
    ✓ Quality: spend not_null           PASSED
    ✓ Quality: no negative ad spend     PASSED
    ✓ Loaded into bigquery

  Completed in 12s

Other Database integrations

Amazon DynamoDB

Amazon DynamoDB

ClickHouse

ClickHouse

Couchbase

Couchbase

CrateDB

CrateDB

DuckDB

DuckDB

Elasticsearch

Elasticsearch

Ready to connect Microsoft SQL Server?

Start for free, or book a demo to see how Bruin handles ingestion, quality, lineage, and scheduling for your entire data stack.

Book a demo Read the docs