Working with Workflows

You can create a Workflow by linking multiple Models and Activations together. You can add conditions on the data in the Destination tables to define how the Models and Activations are run, and transform your data according to your requirements. You can schedule a Workflow to run at a pre-defined frequency. However, you can also use the Run Now option available under the More ( More icon ) icon, to run the Workflow on-demand.

Prerequisites

One or more Models are created in your account. Read Working with Models.


Example

Let us suppose, you have created three Models as follows:

  • Model for the Engineering department (Name: Engineering)

  • Model the first set of employees (Name: Employees 1)

  • Model a second set of employees (Name: Employees 2)

Then, the following image illustrates how a sample Workflow created with these Models with a data load condition looks like:

Workflow case scenario


Creating a Workflow

Perform the following steps to create a Workflow:

  1. In the Asset Palette, click WORKFLOWS.

  2. Click + CREATE WORKFLOW, (for the first Workflow creation only) or + CREATE in the Workflows List View.

    Create Workflow

    A Workflow is created in the Draft state.

  3. In place of Untitled Workflow, specify a name for the Workflow, and click SAVE. The Workflows Detailed View is displayed. You can add one or more Models or Activations along with data load conditions, to create your Workflow.

    Untitled Workflow

  4. Click ADD MODEL, ADD ACTIVATION, and ADD CONDITION to add Models, Activations, and data load conditions to the Workflow, respectively.

  5. Click on a Model or Activation block and perform the following steps:

    Configure Model

    1. Specify the following settings:

      • Select Model or Activation: Select a Model or Activation from the drop-down list that is displayed.

      • Stop on Failure: Enable this option to stop the workflow in case the Model or Activation fails due to some reason.

      • Run Outside Workflow: Enable this option to allow the selected Model or Activation to run independent of the Workflow too. Read Scheduling a Model.

    2. Click SAVE CONFIGURATION. Repeat Step 6 for each Model and Activation that you want to add.

  6. (Optional) Click ADD CONDITION to specify a condition for linking the Models and Activations and specify the following settings:

    Configure Condition

    • Name of the Condition: A unique name for the Condition.

    • Conditions: The condition(s) that you want to apply on the data in the table(s) in the Destination since the last run of the Workflow. You can add multiple conditions and combine them with the And or Or operators.

      • Number of rows loaded in: Select the Destination table from the list of all Destination tables your team has access to, on which you want to apply the condition.

      • Select one of Greater Than Equal To, Lesser Than Equal To, and Greater than Zero conditions. These are used to compare the number of rows loaded in the table since the last run of the Workflow and the value that you provide for comparison.

      • Value: Provide a value to compare with the number of rows loaded in the specified table since the last run of the Workflow. For example, 10.

  7. Hover the mouse over a block to find arrows on all its four sides. These arrows enable you to add other blocks, as required, to create the Workflow.

  8. Click the arrow symbol as required, and hover over another Activation, Condition, or Model available in the Workflow canvas, to find the hollow dots on all fours sides of the block, and then click on a hollow dot to connect the two blocks.

  9. Optionally, use the Undo, Redo, and CLEAR ALL options to modify your Workflow.
    Note: The CLEAR ALL action cannot be undone.

    Modify your Workflow

For example, the Models in the above example are connected in a way such that the queries of the Engineering Model run first, then the query of either Employees 1 and Employees 2 Models run, depending on whether the data load condition Quantity filter is True or False. These Models load the data using the output of the and Engineering Model.

Note: You can only use Models and Activations that are in Active state to create a Workflow.


Scheduling a Workflow

After successfully creating a Workflow, you are required to set a schedule as per which the Workflow must run.

There are two ways in which you can do this:

  • Runs Every: Schedule the Workflow to run at a fixed frequency. The highest frequency is 5 min and the lowest is 24 hours.

  • Custom: Choose Custom in Runs Every option to define a specific time for the Workflow run. The Run On drop-down provides you three options in this:

    • Fixed Interval of: Provide a time interval in hours, at which the Workflow must run. Let us suppose you specify the interval as 4 hours, and as per that, the Workflow is scheduled to run at noon, 4 PM (UTC), 8 PM (UTC), and so on. If you manually run the Workflow between these times, say at 5 PM (UTC), then the next run happens 4 hours after that, at 9 PM (UTC) and not 8 PM (UTC).

    • Daily: Schedule the Workflow to run daily at the specified time.

    • Weekly: Select the days of the week, and the time when you want the Workflow to run.

Click SCHEDULE to set up the schedule. In the Summary Bar, click Change to change the schedule for an existing Workflow.


Modifying a Workflow

You can modify a Workflow after creating it. To do so:

  1. Select your respective Workflow from the Workflow List View.

  2. Click EDIT WORKFLOW.

    Edit Workflow

  3. Make your changes, and once you are done, click SAVE CHANGES.

    Save Workflow changes



Revision History

Refer to the following table for the list of key updates made to this page:

Date Release Description of Change
Sep-07-2022 1.97 Updated the page to add information regarding the latest funtionalities offered by Workflows.
Mar-11-2022 NA - Added sections, Modifying a Workflow and Scheduling a Workflow.
- Updated section, Creating a Workflow.
Dec-10-2021 NA Updated the screenshots to reflect the latest UI.
Last updated on 19 Sep 2022

Tell us what went wrong