Log-based Pipelines

A log based Pipeline moves data from a Source to a Destination by trimming through logs which consist of Events describing changes made to a database, wherein data is ingested at a fixed interval.

These logs are generally maintained for replication or recovery of data.

Hevo supports a variety of log-based Pipelines as listed below:

  1. A MySQL Source configured using BinLog mode.
  2. A PostgreSQL Source configured using Logical replication mode.
  3. A DynamoDB Source.
  4. A MongoDB Source configured using either Change Stream or OpLog mode.
  5. An Aurora Source configured using BinLog mode.
  6. A SQL Server with individual jobs configured with `Change Tracking` as the query mode.

See Also

Last updated on 16 Oct 2020