Manually Triggering the Loading of Events

There may be situations where data is ingested faster than it is loaded to the Destination. As a result, Events may be available and waiting to be loaded before the next scheduled load task. For example, the ingestion frequency of your Pipeline may be 5 minutes while the loading frequency at the Destination may be set as 24 hours. To expedite the loading of Events in such scenarios, Hevo enables you to manually trigger the loading task outside of the defined schedule using the Load Events Now option. For finer control, you can trigger the action at Destination and table level.

This option is available only for data warehouse Destinations. However, it is unavailable while the status of a Destination table is Queued or In-progress, or if there are no pending Events. In cases where the pending Events count becomes too large, Hevo may automatically start loading the Events.

Checking for Pending Events

You can check for Events that are waiting to be loaded at two locations:

  • Pipeline: Access the Load Status tab of the Pipeline to view the Events pending to be loaded.

    Check Event load status in Pipeline

  • Destination: If many Pipelines are loading Events to the Destination, you can check for all pending Events in the Overview tab of the Destinations Detailed View:

    Pending Events in Destination

Triggering the Loading of Events

You can select to load Events for a Pipeline or a data warehouse Destination using the Load Events Now option. This internally schedules a task and starts loading the Events to the Destination.

  • Load Events from the Pipeline

    To load pending Events of a Pipeline to the Destination:

    1. Click PIPELINES in the Asset Palette.

    2. Click the Pipeline for which you want to load Events in the Pipeline List View.

    3. In the Load Status page of the Pipelines Detailed View, scroll to the required table.

    4. Click the Kebab menu icon and select Load Events Now.

      Load Events from Pipeline

  • Load Events for the Destination

    To load Events for all the tables in the Destination:

    1. Click DESTINATIONS in the Asset Palette.

    2. Click the Destination for which you want to load Events in the Destinations List View.

    3. In the Destination Overview page:

      1. Click the Kebab menu icon.

      2. Select Load Events Now.

        Load Events from Destination Overview page

    Note: This option is not displayed for the BigQuery Destination if you have enabled Streaming Writes.

  • Load Events for a Destination Table

    To load Events for a specific table in the Destination:

    1. Click DESTINATIONS in the Asset Palette.

    2. Click the Destination for which you want to load Events in the Destinations List View.

    3. In the Destination Overview page, search for the table you want to load and:

      1. Click the Kebab menu icon.

      2. Select Load Events Now.

        Load Events for a Table



Revision History

Refer to the following table for the list of key updates made to the page:

Date Release Description of Change
23-Mar-2021 1.59 New document.
Last updated on 05 Apr 2021