Manually Triggering the Loading of Events

Last updated on Jun 03, 2024

There may be situations where data is ingested faster than it is loaded to the data warehouse Destination. As a result, Events may be available and waiting to be loaded before the next scheduled load task. For example, the ingestion frequency of your Pipeline may be 5 minutes while the loading frequency at the Destination may be set as 24 hours. To expedite the loading of Events in such scenarios, Hevo provides the Load Events Now option, which allows you to trigger the loading task manually. You can trigger the action at the Destination level and for tables in the Queued, In Progress, or Success statuses. However, if there are no pending Events, this option will not be available. In cases where the pending Events count becomes too high, Hevo may automatically start loading the Events.

On Demand Data Loading

Note: The Load Events Now option is available only for data warehouse Destinations.


Checking for Pending Events

You can check for Events that are waiting to be loaded at two locations:

  • Pipeline: Access the Load Status tab of the Pipeline to view the Events pending to be loaded.

    Check Event load status in Pipeline

  • Destination: If multiple Pipelines are loading Events to the Destination, you can check for all pending Events in the Overview tab of the Destinations Detailed View:

    Pending Events in Destination


Triggering the Loading of Events

You can select to load Events for a Pipeline or a Destination warehouse using the Load Events Now option. This internally schedules a task and starts loading the Events to the Destination.

Note: You must be assigned the Team Administrator, Team Collaborator, Pipeline Administrator, or Pipeline Collaborator role in Hevo to manually trigger the loading of Events.

Load Events from the Pipeline

To load pending Events of a Pipeline to the Destination:

  1. Click PIPELINES in the Navigation Bar.

  2. Click the Pipeline for which you want to load Events in the Pipeline List View.

  3. In the Load Status page of the Pipelines Detailed View, scroll to the required table.

  4. Click the Kebab menu icon and select Load Events Now.

    Load Events from Pipeline

Load Events for the Destination

To load Events for all the tables in the Destination:

  1. Click DESTINATIONS in the Navigation Bar.

  2. Click the Destination for which you want to load Events in the Destinations List View.

  3. In the Destination Overview page, click the Kebab menu icon and select Load Events Now.

    Load Events from Destination Overview page

Note: This option is not displayed for the BigQuery Destination if you have enabled Streaming Writes.

Load Events for a Destination Table

To load Events for a specific table in the Destination:

  1. Click DESTINATIONS in the Navigation Bar.

  2. Click the Destination for which you want to load Events in the Destinations List View.

  3. In the Destination Overview page, scroll to the required table.

  4. Click the Kebab menu icon and select Load Events Now.

    Load Events for a Table


Revision History

Refer to the following table for the list of key updates made to this page:

Date Release Description of Change
Apr-29-2024 2.23.1 Updated the page to reflect the current supported functionality.
Mar-23-2021 1.59 New document.

Tell us what went wrong