How do I resolve duplicate records in the Destination table?

Last updated on May 30, 2023

Duplicate records may occur in the Destination table in two scenarios:

  • When there is no primary key in the Destination table to carry out the deduplication of records.
  • When the Append Rows on Update setting is enabled for the table.

    Append Rows on Update

You can either set up the primary key and re-run the ingestion for that object from the Pipeline Overview tab of the Pipeline Detailed View, or, disable the Append Rows in Update setting for the table.

Note: The changes are applied only on the data loaded subsequently.

Revision History

Refer to the following table for the list of key updates made to this page:

Date Release Description of Change
Nov-07-2022 NA Created as a new document.

Tell us what went wrong