On This Page
CleverTap is an omni-channel platform used by companies to engage and retain their customers across industry domains such as travel, fin-tech, e-commerce, food-tech and hospitality.
You can load your CleverTap Events to a Destination system using Hevo Pipelines.
- The CleverTap project credentials to provide Hevo access to your CleverTap data.
Configuring CleverTap as a Source
Perform the following steps to configure CleverTap as the Source in your Pipeline:
Click PIPELINES in the Asset Palette.
Click + CREATE in the Pipelines List View.
In the Select Source Type page, select CleverTap.
In the Configure your CleverTap Source page, specify the following:
Pipeline Name: A unique name for your Pipeline.
Project ID: The ID obtained from your CleverTap project.
Project Passcode: The password for your CleverTap project.
Note: CleverTap APIs do not return an error when you provide a wrong project ID. Hence, Test Connection might succeed even with a wrong project ID.
Region: The region where your CleverTap account is configured.
Events File: The CSV file containing the list of all the CleverTap events to be ingested. This is required as CleverTap does not provide any API to list all distinct event names or to download all events at one go. Read Downloading the CleverTap Events File to know how to obtain this file.
Click TEST & CONTINUE.
Proceed to configuring the data ingestion and setting up the Destination.
Downloading the CleverTap Events File
Log in to your CleverTap account.
Click the Expand chevron (drop-down icon) at the top left.
From the Your Projects list, select the project from which you want to ingest data.
In the left navigation pane, click Settings.
In the Settings pane, click Schema and select Events from the drop-down.
In the Events page, System events tab, click Download as CSV.
In the pop-up dialog that is displayed, select Events and click Download.
Upload this CSV file in Hevo to configure CleverTap as a Source.
|Default Pipeline Frequency||Minimum Pipeline Frequency||Maximum Pipeline Frequency|
|1 Hr||1 Hr||3 Hrs|
Hevo uses CleverTap’s Get Events API to fetch, download and ingest raw Events from CleverTap.
Historical Sync Duration: In the first run of the Pipeline, Hevo ingests the historical data of the past 30 days for the Events object in your CleverTap account.
Incremental Data: The ingestion of incremental data is done once per day due to rate limits imposed by the Get Events API. Hevo fetches the previous day’s data at 3.00 a.m. (UTC) daily.
- CleverTap’s Get Events API returns duplicate data for some Events. Read Schema and Primary Keys to understand how Hevo handles this.
- You can fetch data from CleverTap in real-time using a Pipeline with a Webhook Type Source in Hevo and use CleverTap webhooks with it.
CleverTap’s Get Events API currently does not support download of the following notifications-related Events:
Notification Control Group
Notification System Control Group
Schema and Primary Keys
Hevo uses CleverTap’s Get Events API to ingest a single object, Events.
The following table lists the schema for the attributes of the Events object used to fetch data from your CleverTap account:
|objectId||Represents the CleverTap ID of the user.||String|
|profileData||Represents all the custom profile properties of the user.||JSON|
|identity||Represents the custom user ID provided by the user.||String|
|ts||Represents the event timestamp in the yyyyMMddHHmmSS format.||Timestamp|
|event_props||Represents the Event properties and their values.||JSON|
|session_props||Represents the session properties and their values. These are only provided if they were set.||JSON|
|session_source||Represents the value of a
Hevo does not receive any primary key in the response from the Get Events API. Hence, Hevo creates its own primary key,
__hevo_id, by hashing the Event’s data and its timestamp. This helps to override any duplicate data received from the API, however, it can result in differences in the count of Events between the Source and the Destination. If you want to replicate the data as is, with possible duplicate records, enable the Append Rows on Update option in the Destination configuration.
Refer to the following table for the list of key updates made to this page:
|Date||Release||Description of Change|
|Jun-09-2022||1.90||- Modified the section, Configuring CleverTap as a Source to reflect the latest UI changes.
- Added section, Downloading the CleverTap Events File.
|May-11-2022||NA||Added a Source consideration about CleverTap’s Get Events API not supporting the export of some notification-related Events.|
|Nov-22-2021||1.76||- Updated the section, Data Replication to add information about duplicate data returned by CleverTap’s Get Events API.
- Updated the section, Schema and Primary Keys to add information about the primary key,
|Oct-25-2021||NA||Added the Pipeline frequency information in the Data Replication section.|
|August-23-2021||1.70||- Updated the Data Replication section with details of the historical sync duration and the incremental data ingestion schedule.
- Added the section, Schema and Primary Keys.