Near Real-time Data Loading using Streaming

On This Page

Hevo offers you the option to load data to your BigQuery Destination in near-real-time by streaming the writes. Using BigQuery’s streaming APIs, Hevo writes the data to the BigQuery Destinations via the InsertAll requests.

Streaming offers the advantage of making data available for querying without having to wait for a job to finish loading data into BigQuery. However, you must also consider the following limitations before choosing to stream the data:

  • Streaming writes incurs additional cost for you. Read Streaming pricing.

  • Once enabled, this option cannot be disabled for the Destination.

  • If Streaming is selected, de-duplication of Events cannot be enabled.

  • If the same tables are referred to in a different Destination, uniqueness cannot be guaranteed.

Revision History

Refer to the following table for the list of key updates made to this page:

Date Release Description of Change
Feb-22-2021 1.57 New document.
Last updated on 11 Oct 2021