peerdb icon indicating copy to clipboard operation
peerdb copied to clipboard

cdc sync source from peerdb target postgres to target postgres error when add new column

Open dramer-817 opened this issue 1 year ago • 2 comments

mirror 1 : source postgres 1 -> target postgres 2 mirror 2 : source postgres 2 -> target postgres 3

add new column on postgres 1, new column added to postgres 2 when next insert, postgres 3 not updated with error

ERROR Activity error. Namespace default TaskQueue peer-flow-task-queue WorkerID 1@fc3a8a9272cd@ WorkflowID normalize-flow-cdc22-0483b0a1-76b7-4d6d-bc02-655527c75d10 RunID 78571805-d5f0-4d58-ad71-ce451271b531 ActivityType StartNormalize Attempt 9 Error failed to normalized records: error executing merge statements: ERROR: column "_PEERDB_SYNCED_AT" specified more than once (SQLSTATE 42701)

when create mirror 2 excluded column _PEERDB_IS_DELETED and _PEERDB_SYNCED_AT any way to make postgres 3 also updated? this can save data transfer costs postgres 1 at cloud provider, postgres 2 and postgres 3 at local network

dramer-817 avatar Jan 05 '24 13:01 dramer-817

Have you tried using column exclusion to omit _PEERDB_IS_DELETED / _PEERDB_SYNCED_AT from source?

@Amogh-Bharadwaj @heavycrystal Ideally we'd support changing deleted/synced column names as another way around this issue. Could fit in with being able to disable option by renaming to ""

serprex avatar Jan 05 '24 16:01 serprex

@serprex tried column exclusion doesn't work

dramer-817 avatar Jan 06 '24 05:01 dramer-817