This update majorly comprises of new flow for pipeline creation and comes packed with various other features which are aimed at providing you with a better experience and giving you more control over your data pipelines.
Here’s a peek at the recent changes we are most excited about:
New Pipeline Creation flow
Hevo had brought you a fresh look for your pipelines recently, we are delighted to inform you that in the recent update we completely redesigned Pipeline creation flow as well, with a sole objective of making your experience smoother while using Hevo. The new flow divides the pipeline creation procedure into logical steps and presents to you a step by step process for pipeline creation while guiding you along the way.
Besides providing you with a better experience, the new flow brings various new capabilities:
Copy connection settings from an existing Source - If you are using a source to power multiple pipelines, you can now copy credentials from another source while creating the pipeline. You now also have an option to use sample source and destination connections while creating your first pipeline in case you just want to explore the product.
Filter Event Types - you can now filter out event types which you don’t want to sync while creating the pipeline. Data from excluded event types will not be read from your source at all.
Ingestion Configuration - Ingestion configuration defines how Hevo is going to read your data from the source, for eg. in case of MySQL source, data can be read either in bulk by reading the whole table at once, or incrementally by detecting new and changed data. You can now define Ingestion Configuration for every event type while creating the pipeline itself.
Changes in Schema Mapper
We have introduced 2 new options to control specific events in the Schema Mapper. These options allow you to repopulate schema for any event type or skip any event type altogether. You can access these options for any event in left Events pane in Schema Mapper.
Clear Schema - This option enables you to clear last identified schema for your event in schema mapper. Doing this will clear the latest detected schema and it will be repopulated once new events are received by Schema Mapper. Please note that doing this will not affect your configured schema mapping.
Skip Events - This option gives you the capability to skip any event type at Schema Mapper stage that you don’t want to send to your Destination. These events will be dropped by Hevo from then onwards. A simple use case of this would be that if Transformation script for that pipeline is generating some child events which are not useful for you in the destination, you can drop those events here.
Replay Queue Sample
To debug issues related to events in Replay Queue, you can now browse and download samples of events parked in Replay Queue.
Refresh Destination Schema
Any new tables created or alterations made to existing tables in your destination might take a few minutes to reflect in Hevo. You can expedite it by using Refresh Destination Schema option for that Destination. To access this option, go to Destinations section and select the desired Destination, you will find Refresh Schema option in the right config pane.
Pipeline list indicators
We have introduced 2 new indicators on pipeline list page for every pipeline along with status to give you a quick insight if there are any incomplete schemas to be mapped or if any events are parked in the Replay Queue.