Shopify

Shopify is a comprehensive e-commerce platform that enables individuals and businesses to create online stores.

Bruin supports Shopify as a source for Ingestr assets, and you can use it to ingest data from Shopify into your data warehouse.

In order to set up Shopify connection, you need to add a configuration item in the .bruin.yml file and in asset file. You need the url of your Shopify store and the api_key. For details on how to obtain these credentials, please refer here.

Follow the steps below to correctly set up Shopify as a data source and run ingestion:

Step 1: Add a connection to .bruin.yml file

To ingest data from Shopify, you need to create an asset configuration file. This file defines the data flow from the source to the destination. Create a YAML file (e.g., shopify_ingestion.yml) inside the assets folder and add the following content:

   connections:
    shopify:
        - name: my-shopify
          url: test.myshopify.com
          api_key: abckey

• api_key: the API key used for authentication with Shopify

Step 2: Create an asset file for data ingestion

name: public.shopify
type: ingestr
connection: postgres

parameters:
  source_connection: my-shopify
  source_table: 'orders'

  destination: postgres

• name: The name of the asset.
• type: Specifies the type of the asset. It will be always ingestr type for Shopify.
• connection: This is the destination connection.
• source_connection: The name of the Shopify connection defined in .bruin.yml.
• source_table: The name of the data table in Shopify you want to ingest.

Available Source Tables

Table	PK	Inc Key	Inc Strategy	Details
orders	id	updated_at	merge	Retrieves Shopify order data including customer info, line items, and shipping details
customers	id	updated_at	merge	Retrieves Shopify customer data including contact info and order history
discounts	id	updated_at	merge	Retrieves Shopify discount data using GraphQL API (use instead of deprecated price_rules)
products	id	updated_at	merge	Retrieves Shopify product information including variants, images, and inventory
inventory_items	id	updated_at	merge	Retrieves Shopify inventory item details and stock levels
transactions	id	id	merge	Retrieves Shopify transaction data for payments and refunds
balance	currency	-	merge	Retrieves Shopify balance information for financial tracking
events	id	created_at	merge	Retrieves Shopify event data for audit trails and activity tracking
price_rules	id	updated_at	merge	DEPRECATED - Use discounts table instead

Step 3: Run asset to ingest data

bruin run assets/shopify_ingestion.yml

As a result of this command, Bruin will ingest data from the given Shopify table into your Postgres database.