Viewing Pipeline Progress

The Progress Bar in the Pipeline Detailed View provides a visual representation of the progress of the data loading process through various stages till data is finally loaded to the Destination. The progress is refreshed every 10 seconds.

Hevo informs you once all the stages have executed successfully, and Events start loading to the Destination.

At this time:

  • For JDBC Destinations, you can click on Explore Data to view the loaded data via the Destination Workbench.

  • The Pipeline Activity graphs are displayed. These are also displayed once the Log task is completed for log-based Pipelines.

    Explore data

The Progress Bar automatically disappears after one hour of all the stages becoming successful, or, 24 hours after Pipeline creation, whichever is sooner.


Data Movement Timeframes

The expected timeframes are mentioned below each stage to indicate the approximate time it will take for the stage to start, and the time it will take to finally load your data to the Destination. This estimate is based on historical averages for such data loads and the calculation of current loads.

Expected data movement timeframes

The icons also help to indicate the current status of a stage. For example, a stage progressed correctly (tick-mark icon), is waiting to start (hourglass icon), or has any errors or warnings (warning icon) by looking at the icons.

Any warnings and errors are displayed below the stage name. Refer to the section below to troubleshoot these.


Historical Load Progress

Historical Load Progress Example

Historical Load Progress is represented as the percentage of active objects ingested out of the total active objects. Let us say, there are four objects (Event Types) in total and the current Historical Load Progress is 50%. This means that two out of the four objects are ingested successfully. This progress changes to 75% and then to 100% respectively, as the third and fourth objects are ingested. The % completion does not relate to the number of Events ingested from any Event Type.

Note: Historical Load Progress is available only for Log-based Pipelines.


Troubleshooting Data Loading Errors

Any warnings and errors are displayed below the stage name. Refer to the section below to troubleshoot these.

Error message example

Refer to the following table to understand some of the typical errors and warnings:

Stage Scenario Type Solution
Connecting with the Source Source connection failed. Error Edit the Source configuration in the Pipeline Connection Settings page.
Connecting with the Source No objects found. Error Check if you have selected at least one object to be loaded.
Ingesting Events No Events found to ingest. Warning Check if you have selected at least one object to be loaded.
Ingesting Events Failed to ingest Events. Error Check if there is data in the objects. If not there, add some data and try again.
Staging Events for Loading Auto Mapping Disabled. Warning Either manually map the Source and Destination fields, or enable Auto Mapping for Hevo to automatically map the fields for you.
Staging Events for Loading Failed to ingest Events. Error Same as above.
Loading Events to Destination (Multiple possibilities) Warning Check the Pipeline Objects to see if there are failures and resolve them, as required.



See Also


Revision History

Refer to the following table for the list of key updates made to this page:

Date Release Description of Change
Nov-09-2021 1.75 Added the section, Historical Load Progress.
Last updated on 08 Nov 2021