How do I resolve duplicate records in the Destination table?

Duplicate records may occur in the Destination table in two scenarios:

• When there is no primary key in the Destination table to carry out the deduplication of records.

• When the Append Rows on Update setting is enabled for the table.

  

You can either set up the primary key and re-run the ingestion for that object from the Pipeline Overview tab of the Pipeline Detailed View, or, disable the Append Rows in Update setting for the table.

Note: The changes are applied only on the data loaded subsequently.

Revision History