Creating a WebHook Pipeline

Last updated on Nov 03, 2022

A Webhook Pipeline is a Pipeline that you create with any Source which offers Webhook connectivity. For example, a Webhook Pipeline you create to ingest data from Mailchimp. Read Webhook.

Let us see an example of moving the data using a Webhook Source to an Amazon Redshift Destination.


Prerequisite


Configure the Source

  1. Log in to your Hevo account. By default, PIPELINES is selected in the Asset Palette.

  2. (Optional) Select the region in which you want to create your Pipeline, if this is different from the default region of your workspace.

    Note: This is applicable for customers signing up after Oct 31, 2022.

  3. Select Webhook from the list of Sources. The list is displayed based on the Sources you select while setting up your account with Hevo.

    Create Pipeline

    If Webhook is not available in the displayed list, click View All, search for Webhook, and then select it in the Select Source Type page.

    Select Webhook

  4. In the Configure your Webhook Source page, specify the JSON path to the root of the Event name and root of the fields present in your payload. Read Writing JSONPath Expressions.

    Note: The fields may vary depending on the Destination type. Read Sources.

    Configure Webhook

  5. Click CONTINUE.


Select and Configure Destination

  1. In the Select Destination Type page, select your Destination. You can see the Destination type that you selected at the time of setting up your account with Hevo. Here, we are selecting Amazon Redshift.

    Note: You can click View All Destination Types to select another Destination type.

    Select Amazonredshift

  2. In the Configure your Amazon Redshift Destination page, specify the Amazon Redshift database settings. Read Amazon Redshift to know how to configure your Amazon Redshift Destination.

    Note: The fields may vary depending on the type of the Destination you want to configure. Read Destinations.

    Configure AmazonRedshift

  3. Click SAVE & CONTINUE.

  4. In the Destination Table Prefix field, provide a prefix if you want to modify the Destination table or partition name, else, you can leave the field blank.

  5. Click CONTINUE.

    A Webhook URL gets generated along with the sample payload. Read Webhook.


Set up Webhook

  • Copy and paste the generated Webhook URL in Step 2 above, in the application from which you want to push events to Hevo. You can use the sample snippets to check the Webhook URL connectivity to Hevo.

    Set up Webhook


Final Settings

  • Optionally, as part of the final settings, you can set up Transformations to cleanse the Source data or enrich it in any other way. You can also view the Source to Destination field mapping via the Schema Mapper and edit these, if needed.

    Your first pipeline with the Webhook Source is created and the data ingestion starts.


Revision History

Refer to the following table for the list of key updates made to this page:

Date Release Description of Change
Oct-31-2022 2.00 Updated section, Configure the Source to add step regarding selecting region before creating a Pipeline.
Jul-27-2022 1.93 & 1.94 Updated the screenshot in the Select and Configure Destination section to reflect the latest UI.
Mar-21-2022 NA New document.

Tell us what went wrong