Docs
HevoData.com
Free Trial
  • Getting Started
    • User Roles
  • Using Hevo
    • Familiarizing with the UI
    • Asset Palette
    • Global Search
    • User Information Panel
    • Keyboard Shortcuts
    • Switching to Dark Mode
    • UI Elements and Terms Reference
  • Pipelines
    • Familiarizing with the Pipelines UI
    • Pipeline Concepts
      • Pipeline Modes
      • Types of Data Synchronization
      • Pipeline Objects
        • Managing Objects in Pipelines
        • Query Modes for Ingesting Data from Relational Databases
      • Data Ingestion
        • Data Ingestion Statuses
        • Deferred Data Ingestion
      • Handling of Updates
      • Data Loss Prevention
      • Events
        • Ingestion Limits for Events
        • Loading Events in Batches
        • Failed Events in a Pipeline
          • Reasons for Event Failures
          • Resolving Event Failures
      • Parsing Nested JSON Fields in Events
      • Table and Column Name Compression
      • Hevo-generated Metadata
        • Metadata Column __hevo_database_name
        • Metadata Column __hevo_id
    • Working with Pipelines
      • Creating a Pipeline
      • Viewing Pipeline Progress
      • Scheduling a Pipeline
      • Prioritizing a Pipeline
      • Pausing and Deleting a Pipeline
      • Log-based Pipelines
        • Pausing a Log-based Pipeline
        • Handling Deletes in Log-based Pipelines
    • Transformations
      • Python Code-Based Transformations
        • Example - Splitting Nested Events into Multiple Events
        • API References
          • Event Object
          • TimeUtils
          • Utils
      • Drag and Drop Transformations
        • Transformations and Properties
        • Examples of Drag and Drop Transformations
      • Transformation Reference
        • Datetime Field Values
        • Rounding Modes
        • Text Casing
        • Values and Formulas
    • Schema Mapper
      • Using Schema Mapper
      • Mapping Statuses
      • Auto Mapping Event Types
        • Modifying Schema Mapping for Auto Mapped Event Types
      • Mapping a Source Event Type with a Destination Table
      • Mapping a Source Event Type Field with a Destination Table Column
      • Schema Mapper Actions
      • Fixing Unmapped Fields
      • Resolving Incompatible Schema Mappings
      • Resizing String Columns in the Destination
      • Creating File Partitions for S3 Destination through Schema Mapper
      • Schema Mapper Compatibility Table
  • Sources
    • Free Sources
    • Analytics
      • Amplitude Analytics
      • CleverTap
      • Google Analytics
        • Google Analytics Filters
      • Google Analytics 360
      • Google Play
      • Google Search Console
      • Localytics
      • Mixpanel
    • Cloud Applications
      • Freshdesk
      • GitHub
      • Google Sheets
      • Intercom
        • Intercom App
        • Intercom Webhook
      • Jira
      • Pardot
      • Salesforce
      • Salesforce Marketing Cloud
      • Shopify
        • Shopify App
        • Shopify Webhook
      • Zendesk
    • Databases
      • Amazon DynamoDB
      • Amazon Redshift
      • Elasticsearch
      • Magento
      • MongoDB
        • Example - Merge Collections Feature
        • Generic MongoDB
        • MongoDB Atlas
        • Troubleshooting MongoDB Change Streams Connection
        • Troubleshooting MongoDB OpLog Connection
      • MySQL
        • Amazon Aurora MySQL
        • Amazon RDS MySQL
        • Azure MySQL
        • Google Cloud MySQL
        • Generic MySQL
        • MariaDB MySQL
        • Common Issues in MySql Binary Logs Based Replication
      • Oracle
        • Generic Oracle
        • Amazon RDS Oracle
      • PostgreSQL
        • Amazon Aurora PostgreSQL
        • Amazon RDS PostgreSQL
        • Azure PostgreSQL
        • Google Cloud PostgreSQL
        • Generic PostgreSQL
        • Heroku PostgreSQL
      • SQL Server
        • Amazon RDS MS SQL
        • Azure MS SQL
        • Generic MS SQL Server
        • Google Cloud SQL Server
    • File Storage
      • File Log
      • Amazon S3
      • FTP / SFTP
      • Google Cloud Storage (GCS)
      • Google Drive
    • Marketing & Email
      • AdRoll
      • Apple Search Ads
      • AppsFlyer
      • Criteo
      • Facebook Ads
      • Facebook Pages
      • Google Campaign Manager
      • Google AdWords
      • HubSpot
      • Instagram Business
      • Klaviyo
      • LinkedIn Ads
      • Mailchimp
      • Marketo
      • Microsoft Ads
      • Outbrain
      • SendGrid
      • SendGrid Webhook
      • Twitter Ads
      • YouTube Analytics
    • Payments
      • Stripe
    • Sdk & Streaming
      • Android SDK
      • Kafka
        • Apache Kafka
        • Kafka Confluent Cloud
      • REST API
        • Writing JSONPath Expressions
      • Segment
      • Webhook
  • Destinations
    • Familiarizing with the Destinations UI
    • Name Sanitization
    • Data Warehouses
      • Amazon Redshift
      • Google BigQuery
        • Clustering in BigQuery
        • Near Real-time Data Loading using Streaming
        • Partitioning in BigQuery
      • Hevo Managed Google BigQuery
        • Connecting BI Tools to Hevo
          • Connecting Chartio to Hevo
          • Connecting Google Data Studio to Hevo
          • Connecting Looker to Hevo
          • Connecting Metabase to Hevo
          • Connecting Microsoft Power BI to Hevo
          • Connecting Redash to Hevo
          • Connecting Tableau to Hevo
      • Snowflake
      • Loading Data to a Data Warehouse
        • Loading Data to an Amazon Redshift Data Warehouse
        • Loading Data to a Google BigQuery Data Warehouse
        • Loading Data to a Snowflake Data Warehouse
      • Manually Triggering the Loading of Events
    • Databases
      • Amazon Aurora
      • Microsoft SQL Server
      • MySQL
      • PostgreSQL
      • Loading Data in a Database Destination
  • Transform
    • Models
      • Familiarizing with the Models UI
      • Types of Models
      • Key Features
        • Query Export Options
        • Templatized Queries
        • Model Reset
      • Creating and Modifying Models
      • Previewing a Model
      • Viewing the Query History
      • Legacy Models
        • Legacy Models in Hevo
        • Updating Legacy Models
    • Workflows
      • Creating a Workflow
      • Editing a Workflow
      • Scheduling and Running a Workflow
      • Viewing Workflow History
  • Activate
    • Familiarizing with the Activate UI
    • Creating and Modifying Activations
    • Creating an Activation Target
  • Concepts and Reference
    • Alerts
      • Customizing Alert Preferences
    • Getting Alerts in Slack
    • Activity Log
    • Activity Logs - Cloudwatch Sync
  • Account Management
    • Personal Settings
      • Changing Your Password
      • Resetting Your Password
      • Two-Factor Authentication
    • Team Settings
      • Inviting and Moderating Team Members
      • Enforcing Google Authentication Across Your Team
      • Enforcing Two-Factor Authentication Across Your Team
    • Billing
      • Hevo Trial Account
      • Pricing Plans
      • Setting up Pricing Plans, Billing, and Payments
      • Purchasing Additional Sources and Events
      • Billing Alerts
      • Viewing Billing History
      • Pipeline Usage Summary
      • Billing Notifications
  • About Hevo
    • Security
      • Customer Data Retention and Encryption
      • Infrastructure Security
      • Company Security Standards and Practices
      • Password and Account Lockout Policy
      • Connecting Through SSH
      • Connecting Through Reverse SSH Tunnel
    • Regulatory Compliance
    • Regions
    • Hevo Support
  • FAQs
    • Billing FAQs
    • Pipeline FAQs
    • Destination FAQs
    • Source FAQs
  • Release Notes
    • Release Version 1.60 (06-Apr-2021)
    • Release Version 1.59 (23-Mar-2021)
    • Release Version 1.58 (09-Mar-2021)
    • Release Version 1.57 (22-Feb-2021)
    • Release Version 1.56 (09-Feb-2021)
    • Release Version 1.55 (25-Jan-2021)
    • Release Version 1.54 (12-Jan-2021)
    • Release Version 1.53 (22-Dec-2020)
    • Release Version 1.52 (03-Dec-2020)
    • Release Version 1.51 (10-Nov-2020)
    • Release Version 1.50 (19-Oct-2020)
    • Release Version 1.49 (28-Sep-2020)
    • Release Version 1.48 (01-Sep-2020)
    • Release Version 1.47 (06-Aug-2020)
    • Release Version 1.46 (21-Jul-2020)
    • Release Version 1.45 (02-Jul-2020)
    • Release Version 1.44 (11-Jun-2020)
    • Release Version 1.43 (15-May-2020)
    • Release Version 1.42 (30-Apr-2020)
    • Release Version 1.41 (Apr-2020)
    • Release Version 1.40 (Mar-2020)
    • Release Version 1.39 (Feb-2020)
    • Release Version 1.38 (Jan-2020)
HevoData.com
Talk to Us
Free Trial
  1. Hevo Documentation
  2. Pipelines
  3. Pipeline Concepts

Pipeline Concepts

The articles in this section describe how Hevo handles different aspects related to the ingestion and replication of data to the Destination system.



  • Articles in this section
    • Pipeline Modes
    • Types of Data Synchronization
    • Pipeline Objects
      • Managing Objects in Pipelines
      • Query Modes for Ingesting Data from Relational Databases
    • Data Ingestion
      • Data Ingestion Statuses
      • Deferred Data Ingestion
    • Handling of Updates
    • Data Loss Prevention
    • Events
      • Ingestion Limits for Events
      • Loading Events in Batches
      • Failed Events in a Pipeline
        • Reasons for Event Failures
        • Resolving Event Failures
    • Parsing Nested JSON Fields in Events
    • Table and Column Name Compression
    • Hevo-generated Metadata
      • Metadata Column __hevo_database_name
      • Metadata Column __hevo_id
Last updated on 25 Feb 2021
Was this page helpful?

Thank you for helping improve Hevo's documentation. If you need help or have any questions, please consider contacting support.

Copyright © 2021

© Hevo Data Inc. 2021. All Rights Reserved.
Privacy Terms of Service