Creating your First Pipeline

Last updated on Mar 05, 2024

Hevo provides a quick 4-step process to set up a data Pipeline.

Pipeline Life Cycle

A simple Pipeline can be set up in less than 3 minutes whereas a complex one could take you around 30 minutes. Post Pipeline setup, Hevo moves the data to the Destination in two steps:

  1. Ingests the historical data from the Source in batches and loads them to the Destination.

  2. Fetches the new, incremental data from the Source in micro-batches at frequent intervals (depending on Source configuration) and applies them to the Destination.

To get started with creating Pipelines in Hevo, you essentially need:


Types of Pipelines in Hevo

In Hevo, you can primarily create the following categories of Pipelines depending on the type of Source you select:

Starting Release 2.21, Hevo provides an option to create streaming Pipelines with the log-based ingestion mode or convert existing log-based Pipelines to streaming ones for your database Sources. A streaming Pipeline ingests and loads data in near real-time. You can contact the Sales team to convert an existing log-based Pipeline to streaming or to create one for you.

Request a Streaming Pipeline

Note:

  • A streaming Pipeline is always created in the Paused state.

  • You cannot revert a streaming Pipeline to ingest data on a frequency-based schedule. For this, you need to contact the Sales team.


Revision History

Refer to the following table for the list of key updates made to this page:

Date Release Description of Change
Mar-05-2024 2.21 Removed information about not being able to change ingestion frequency for log-based Sources.
Mar-21-2022 NA New document.

Tell us what went wrong