When the size of incoming String data in source is larger than the size of the mapped column in destination, the record will not be copied to the destination. In this case, the event will be parked in the Replay Queue.
In Schema Mapper tab, under options for your event type, click on Resize String Fields and in the next popup, click on Proceed. Once this is done, you will be able to see the changes reflected in the destination schema after a minute or two.
You will not have to resize each of the columns one by one. Hevo will do that automatically for you depending on the maximum size it has seen in the incoming records till now. While selecting the size of the column, it uses the next larger number which is a power of 2. For example, if the maximum length seen till now is 150, then the destination column will be resized to 256.
Once this this done you need to replay the replay queue. All the previous records should get successfully copied into the destination.
- This option is currently available only for Redshift destination.
- If one of the columns to be resized is a key, then the resize operation will fail.