Transform

While Pipelines in Hevo address the Extract and Load steps in our Extract-Load-Transform (ELT) approach of moving your data from the Source to the Destination warehouse, the Transform step is achieved using dbt™ Models, SQL Models and Workflows.

The most important benefit of the ELT approach is that you can transform your Source data in any manner, and any number of times. You can also transform only the data you need for a particular business analysis. To enable this, Hevo offers the intuitive and easy-to-use Models interface, where you can apply transformations on the data till you reach the final data model that is required for your business reporting and intelligence needs. Using the Query Builder in Models, you can design and test standard SQL queries that can aggregate data from one or more systems and transform it for analysis and reporting and work closely with the Destination schema. You can also create SQL Join clauses that can combine data from multiple tables, and write the query results into a new table.

Furthermore, Hevo integrates with dbt Core™, the open-source CLI offering from dbt that allows you to transform the data in your data warehouse Destinations. You can configure dbt™ Models in Hevo and connect to the Git repository hosting your dbt projects to run the models within the project. These models, containing SELECT statements, are run against the Destination tables specified in your SQL query. The results are then loaded into the target tables and views in your data warehouse Destination.

Workflows further extend the functionality offered by dbt and SQL Models. They provide you with a powerful way to derive insights of your business. Workflows allow you to join multiple Models, whereby the output from one Model can form the input to one or more Models. This enables you to perform deeper analysis and gather important data inputs for your reporting and BI needs.

You can schedule the Models and Workflows to run at specific times and frequency, giving you further independence and control in analyzing your data.

• Articles in this section
  • dbt™ Models
    • Familiarizing with the dbt™ Models UI
    • Setting up dbt™ Projects in Git
    • Working with dbt™ Projects
      • Configuring a dbt™ Project
      • Modifying a dbt™ Project
      • Scheduling a dbt™ Project
      • Viewing dbt™ Project Run Details
      • Pausing and Deleting dbt™ Projects
      • dbt™ Project and Model Run Statuses
  • SQL Models
    • Familiarizing with the Models UI
    • Types of Models
    • Key Features
      • Query Export Options
      • Templatized Queries
      • Model Reset
    • Working with SQL Models
    • Previewing a Model
    • Viewing the Query History
    • Legacy Models
      • Legacy Models in Hevo
      • Updating Legacy Models
    • Models FAQs
      • Can I use Models to make changes to the data in my Source?
      • Can I use Models to transform and load data in real-time?
  • Workflows
    • Familiarizing with the Workflows UI
    • Working with Workflows
    • Viewing the Workflow History
    • Workflows FAQs
      • If I change the schedule of a Workflow, will it impact the schedule of each Model?

Revision History