Pipelines

What is a Pipeline?

A Pipeline moves your data from a Source to a Destination.

Pipeline Components

A Pipeline has the following components:

• Source: A Source is a database, an API endpoint or a File Storage which has the data that you want to analyze. Hevo integrates with a variety of Sources. Complete documentation on using various Sources can be found here.
• Transformations: Transformations are used when you want to clean, enrich or transform your data before loading it to your destination. Check out Transformations to know more.
• Schema Mapper: Schema Mapper lets you map you source schemas to tables in your destination warehouse. Check out Schema Mapper to know more.
• Destination: Destination is a data warehouse or data lake where that data collected from Sources is stored. Various destination supported by Hevo is listed here.

• Articles in this section
  • Familiarizing with the Pipelines UI
  • Scheduling a Pipeline
  • Prioritizing a Pipeline
  • Pausing or Deleting a Pipeline
  • Pipeline Jobs
    • Pipeline Job Statuses
    • Pausing a Job
    • Restarting a Job
    • Viewing Sample Events for a Job
  • Log-based Pipelines
    • Pausing a Log-based Pipeline
    • Handling Deletes in Log-based Pipelines
  • Transformations
    • Viewing Transformation Code History
    • API References
      • Event Object
      • TimeUtils
      • Utils
    • Examples
      • Example - Splitting Nested Events into Multiple Events
  • Schema Mapper
    • Using Schema Mapper
    • Mapping Statuses
    • Mapping a Source Event Type with a Destination Table
    • Mapping a Source Event Type Field with a Destination Table Column
    • Resizing String Columns in the Destination
    • Fixing Unmapped Fields
    • Resolving Incompatible Schema Mappings
    • Bulk Actions in Schema Mapper
    • Auto Mapping Event Types
      • Modifying Schema Mapping for Auto Mapped Event Types
    • Creating File Partitions for S3 Destination through Schema Mapper
    • Schema Mapper Compatibility Table