Working with Workflows
On This Page
Using Hevo Transform, you can create a Workflow by linking multiple Models together. This is a step-wise procedure to load the data to the Destination table, and transform it according to your requirements. You can schedule a Workflow to run at a pre-defined frequency. However, you can also use the Run Now option available under the More ( ) icon, to run the Workflow on-demand.
Prerequisites
One or more Models are created in your account. Read Working with Models.
Case Scenario
Let us suppose, you have created various Models as follows:
-
Model for customer details (Name:
customer_details
) -
Model for product details (Name:
product_details
) -
Model for order details (Name:
order_details
)
The following image illustrates how the Workflow created with these Models looks like:
Creating a Workflow
Perform the following steps to create a Workflow:
-
In the Asset Palette, click TRANSFORM.
-
Click CREATE WORKFLOW (for first Workflow creation only) or + CREATE WORKFLOW in the Workflows List View.
A Workflow is created in the Draft state.
-
In place of Untitled Workflow, specify a name for the Workflow, and click SAVE.
-
The Workflows Detailed View is displayed, where you can add one or more Models to create your Workflow. Click + ADD NEW STEP. A drop-down dialogue box with the list of Models is displayed. From this drop-down, select your desired Models one by one.
-
Hover the mouse on the Model name to find hollow dots on all four sides of the Model name. Hover on any of these four dots to find a + symbol.
-
Click the + symbol, and connect the Models.
-
Optionally, modify your Workflow while creating it using the following buttons:
-
Undo & Redo: Click UNDO and REDO step options to modify your actions.
-
Reset: Click the RESET button in the Workflow screen to clear all the work that you have done with the Workflow.
Note: This action cannot be undone.
-
For example, we are connecting the Models in the above example such that the queries of the customer_details
and product_details
Models run first, then the query of the order_details
Models runs. This Model loads the data using the output of the customer_details
and product_details
Models.
Note: You cannot use the Models that are in the Draft state.
Scheduling a Workflow
After successfully creating a Workflow, you are required to set a schedule as per which the Workflow must run.
There are two ways in which you can do this:
-
Runs Every: Schedule the Workflow to run at a fixed frequency. The highest frequency is 5 min and the lowest is 24 hours.
-
Custom: Choose Custom in Runs Every option to define a specific time for the Workflow run. The Run On drop-down provides you three options in this:
-
Fixed Interval of: Provide a time interval in hours, at which the Workflow must run. Let us suppose you specify the interval as 4 hours, and as per that, the Workflow is scheduled to run at noon, 4 PM (UTC), 8 PM (UTC), and so on. If you manually run the Workflow between these times, say at 5 PM (UTC), then the next run happens 4 hours after that, at 9 PM (UTC) and not 8 PM (UTC).
-
Daily: Schedule the Workflow to run daily at the specified time.
-
Weekly: Select the days of the week, and the time when you want the Workflow to run.
-
Click SCHEDULE to set up the schedule. In the Summary Bar, click Change to change the schedule for an existing Workflow.
Modifying a Workflow
You can modify a Workflow after creating it. To do so:
-
Select your respective Workflow from the Workflow List View.
-
Click EDIT WORKFLOW.
-
Make your changes, and once you are done, click SAVE CHANGES.
Revision History
Refer to the following table for the list of key updates made to this page:
Date | Release | Description of Change |
---|---|---|
Mar-11-2022 | NA | - Added sections, Modifying a Workflow and Scheduling a Workflow. - Updated section, Creating a Workflow. |
Dec-10-2021 | NA | Updated the screenshots to reflect the latest UI. |