tiflow
tiflow copied to clipboard
"RowChangedEvent fallback row, ignore it" when injecting CDC and Kfaka consumer network partition
What did you do?
- Topo: Upstream TiDB --CDC-- Kafka -- Consumer -- MySQL
- create Kafka open protocol changefeed: /cdc cli changefeed create "--server=127.0.0.1:8301" "--sink-uri=kafka://downstream-kafka.cdc-kafka-controller-tps-7508966-1-706:9092/cdc_kafka_network_partition?replication-factor=2&max-message-bytes=1048576&protocol=open-protocol" "--changefeed-id=kafka-open-protocol-task-1
- Run sysbench prepare
- Run sysbench workload and at the same time inject CDC owner to Kafka controller network partition.
- Run kafka consumer to consumer the kafka msg to MySQL
- Do data consistency check between TiDB and MySQL
What did you expect to see?
Kafka consumer should not panic, and kafka msg consumed correctly and data consistency check passed.
What did you see instead?
Consumer shoult not panic, and data consistency check passed betwen TiDB and MySQL
[writer.go:362] ["RowChangedEvent fallback row, ignore it"] [commitTs=450190641590173785] [watermark=450190655496913022] [partition=2] [row="{\"StartTs\":0,\"CommitTs\":450190641590173785,\"RowID\":0,\"PhysicalTableID\":0,
Versions of the cluster
CDC : 350a2fb4596b489af648982082e60ea5735178ff Consumer: c70aaf2590c0efcf4c8cce58d52ed88e7c20d287