Working with Workflows

Using Hevo Transform, you can create a Workflow by linking multiple Models together. This is a step-wise procedure to load the data to the Destination table, and transform it according to your requirements. You can schedule a Workflow to run at a pre-defined frequency. However, you can also use the Run Now option available under the More ( More icon ) icon, to run the Workflow on-demand.

Prerequisites

One or more Models are created in your account. Read Working with Models.


Case Scenario

Let us suppose, you have created various Models as follows:

  • Model for customer details (Name: customer_details)

  • Model for product details (Name: product_details)

  • Model for order details (Name: order_details)

The following image illustrates how the Workflow created with these Models looks like:

Workflow case scenario


Creating a Workflow

Perform the following steps to create a Workflow:

  1. In the Asset Palette, click TRANSFORM.

  2. Click CREATE WORKFLOW (for first Workflow creation only) or + CREATE WORKFLOW in the Workflows List View.

    Workflow List View Create

    A Workflow is created in the Draft state.

  3. In place of Untitled Workflow, specify a name for the Workflow, and click SAVE.

  4. The Workflows Detailed View is displayed, where you can add one or more Models to create your Workflow. Click + ADD NEW STEP. A drop-down dialogue box with the list of Models is displayed. From this drop-down, select your desired Models one by one.

    Add New Step

  5. Hover the mouse on the Model name to find hollow dots on all four sides of the Model name. Hover on any of these four dots to find a + symbol.

  6. Click the + symbol, and connect the Models.

  7. Optionally, modify your Workflow while creating it using the following buttons:

    Modify Workflow

    • Undo & Redo: Click UNDO and REDO step options to modify your actions.

    • Reset: Click the RESET button in the Workflow screen to clear all the work that you have done with the Workflow.

      Note: This action cannot be undone.

For example, we are connecting the Models in the above example such that the queries of the customer_details and product_details Models run first, then the query of the order_details Models runs. This Model loads the data using the output of the customer_details and product_details Models.

Note: You cannot use the Models that are in the Draft state.


Scheduling a Workflow

After successfully creating a Workflow, you are required to set a schedule as per which the Workflow must run.

There are two ways in which you can do this:

  • Runs Every: Schedule the Workflow to run at a fixed frequency. The highest frequency is 5 min and the lowest is 24 hours.

  • Custom: Choose Custom in Runs Every option to define a specific time for the Workflow run. The Run On drop-down provides you three options in this:

    • Fixed Interval of: Provide a time interval in hours, at which the Workflow must run. Let us suppose you specify the interval as 4 hours, and as per that, the Workflow is scheduled to run at noon, 4 PM (UTC), 8 PM (UTC), and so on. If you manually run the Workflow between these times, say at 5 PM (UTC), then the next run happens 4 hours after that, at 9 PM (UTC) and not 8 PM (UTC).

    • Daily: Schedule the Workflow to run daily at the specified time.

    • Weekly: Select the days of the week, and the time when you want the Workflow to run.

Click SCHEDULE to set up the schedule. In the Summary Bar, click Change to change the schedule for an existing Workflow.


Modifying a Workflow

You can modify a Workflow after creating it. To do so:

  1. Select your respective Workflow from the Workflow List View.

  2. Click EDIT WORKFLOW.

    Edit Workflow

  3. Make your changes, and once you are done, click SAVE CHANGES.

    Save Workflow changes



Revision History

Refer to the following table for the list of key updates made to this page:

Date Release Description of Change
Mar-11-2022 NA - Added sections, Modifying a Workflow and Scheduling a Workflow.
- Updated section, Creating a Workflow.
Dec-10-2021 NA Updated the screenshots to reflect the latest UI.
Last updated on 11 Mar 2022