Creating a SaaS Pipeline

Last updated on Oct 06, 2023

A SaaS Pipeline is a Pipeline that you create with any SaaS-based application as your Source, for example, Shopify or Facebook Ads. For the Destination, you can choose any database or data warehouse based on your business requirement.

For some Sources, Hevo also provides you a fully-managed Google BigQuery data warehouse as a Destination. To use it as a Destination in your Pipeline, your email ID and domain must be associated with an active Google, G Suite, or Google Cloud Identity account.

Note: Refer to the list of Sources with which you can use the Hevo-managed Google BigQuery Destination.

Let us see an example of creating a Pipeline and moving the data from the Shopify Source to a Hevo-managed Google BigQuery database. You can select any Destination of your choice.


Prerequisite


Configure the Source

  1. Log in to your Hevo account. By default, PIPELINES is selected in the Navigation Bar.

  2. (Optional) Select the region in which you want to create your Pipeline, if this is different from the default region of your workspace.

    Note: This is applicable for customers signing up after Oct 31, 2022.

  3. Select Shopify from the list of displayed Sources (the list of Sources you select at the time of setting up your account with Hevo).

    Create Pipeline

    If Shopify is not available in the displayed list, click View All, search for Shopify, and then select it from the Select Source Type page.

    Select Shopify

  4. In the Configure your Shopify Source page, specify the Shopify connection settings.

    Note: The fields may vary depending on the Source type. Read Sources.

    Configure Shopify

  5. Click TEST & CONTINUE.


Select and Configure the Destination

  1. In the Select Destination Type page, click Managed Warehouse to configure it as the Destination. Read the list of Sources supporting Hevo Managed Warehouse (MWH). Alternatively, you can select any other Destination of your choice by clicking on View All Destination Types.

    Create Pipeline

  2. In the Set up a Destination page, enter a name for the managed BigQuery Destination.

    Create Pipeline

  3. Click CONTINUE.


Final Settings

  • Optionally, as part of the final settings, you can set up Transformations to cleanse the Source data or enrich it in any other way. You can also view the Source to Destination field mapping via the Schema Mapper and edit these, if needed.

    Your first Pipeline with the SaaS Source is created and the data ingestion starts.


Revision History

Refer to the following table for the list of key updates made to this page:

Date Release Description of Change
Oct-31-2022 2.00 Updated section, Configure the Source to add step regarding selecting region before creating a Pipeline.
Jul-27-2022 1.93 & 1.94 Updated the screenshot in the Select and Configure the Destination section to reflect the latest UI.
Mar-21-2022 NA New document.

Tell us what went wrong