Creating a SaaS Pipeline

Last updated on Feb 05, 2024

A SaaS Pipeline is a Pipeline that you create with any SaaS-based application as your Source, for example, Shopify or Facebook Ads. For the Destination, you can choose any database or data warehouse based on your business requirement.

Let us see an example of creating a Pipeline and moving the data from the Shopify Source to any Destination of your choice.


Prerequisite


Configure the Source

  1. Log in to your Hevo account. By default, PIPELINES is selected in the Navigation Bar.

  2. (Optional) Select the region in which you want to create your Pipeline, if this is different from the default region of your workspace.

    Note: This is applicable for customers signing up after Oct 31, 2022.

  3. Select Shopify from the list of displayed Sources (the list of Sources you select at the time of setting up your account with Hevo).

    Create Pipeline

    If Shopify is not available in the displayed list, click View All, search for Shopify, and then select it from the Select Source Type page.

    Select Shopify

  4. In the Configure your Shopify Source page, specify the Shopify connection settings.

    Note: The fields may vary depending on the Source type. Read Sources.

    Configure Shopify

  5. Click TEST & CONTINUE.


Select and Configure the Destination

  1. In the Select Destination Type page, select your Destination. You can see the Destination type that you selected at the time of setting up your account with Hevo. Here, we are selecting Amazon Redshift.

    Note: You can click View All Destination Types to select another Destination type.

    Select Destination

  2. In the Configure your Amazon Redshift Destination page, specify the Amazon Redshift database settings. Read Amazon Redshift to know how to configure your Amazon Redshift Destination.

    Note: The fields may vary depending on the type of the Destination you want to configure. Read Destinations.

    Select Destination

  3. Click SAVE & CONTINUE.

  4. In the Destination Table Prefix field, provide a prefix if you want to modify the Destination table or partition name, else, you can leave the field blank.

  5. Click CONTINUE.


Final Settings

  • Optionally, as part of the final settings, you can set up Transformations to cleanse the Source data or enrich it in any other way. You can also view the Source to Destination field mapping via the Schema Mapper and edit these, if needed.

    Your first Pipeline with the SaaS Source is created and the data ingestion starts.


Revision History

Refer to the following table for the list of key updates made to this page:

Date Release Description of Change
Oct-31-2022 2.00 Updated section, Configure the Source to add step regarding selecting region before creating a Pipeline.
Jul-27-2022 1.93 & 1.94 Updated the screenshot in the Select and Configure the Destination section to reflect the latest UI.
Mar-21-2022 NA New document.

Tell us what went wrong