Schema Mapper

Schema Mapper helps you define how the data fetched from your Source application must be stored in the Destination.

You can use Schema Mapper to do the following:

• Automatically map Source Event Types to Destination tables: You can use the Auto Mapping feature to automate the mappings between the Source Event Types and the Destination tables. It:

  • Creates and manages all the mappings for you.

  • Creates tables with compatible and optimal data types in your Destination warehouse, if they do not already exist.

  • Marks incompatible incoming Events as Failed for your review.

  You can enable Auto Mapping for the entire Pipeline or specific objects.

• Manually map an incoming Event Type to a Destination table: You can map each field of the Source Event Type to a matching column of a Destination table of your choice. You can modify the mappings and or select a different Destination table at any time.

• Omit unwanted fields from being stored in the Destination table: You can skip the fields you do not want to load by leaving them unmapped. Unmapped fields are not loaded to the Destination tables. For example, you may not want to load sensitive information, such as, your users’ personal details and financial records. Or, you may want to omit large text fields like descriptions, summaries, and comments.

• Flatten nested objects into a de-normalized Destination table: The Schema Mapper suggests a de-normalized, flat structure for your incoming any nested objects in the incoming data. This feature improves the query performance and reduces schema complexity.

• Compress long names of Events and Event Types: The Schema Mapper creates meaningful, shorter names to adhere to the character limit set for table and column names in the Destination.

• Delete existing mappings and create new Destination tables: In the Schema Mapper, you can create a Destination table in real time and map a Source Event Type to it.

In this Section

The following interactive diagram illustrates the features and actions offered by the Schema Mapper and provides a summary view of the section’s content. Click on any item in the diagram to view the related information.

Revision History