br icon indicating copy to clipboard operation
br copied to clipboard

The BR cdc incremental recovery operation will not be recorded in cdclog.

Open tongtongyin opened this issue 5 years ago • 2 comments

Please answer these questions before submitting your issue. Thanks!

  1. What did you do? If possible, provide a recipe for reproducing the error. Turn on cdc synchronization, perform a full backup A, and then insert some data into the instance. Then perform BR incremental recovery twice in succession, then the second BR incremental recovery will have the problem of inconsistency with the data required by the user. Because BR incremental recovery operations will not be recorded in the cdclog.

  2. What did you expect to see? After cdc synchronization is enabled, when BR incremental recovery is performed, the operation of BR incremental recovery can be recorded in cdclog.

  3. What did you see instead?

  4. What version of BR and TiDB/TiKV/PD are you using?

  1. Operation logs

    • Please upload br.log for BR if possible
    • Please upload tidb-lightning.log for TiDB-Lightning if possible
    • Please upload tikv-importer.log from TiKV-Importer if possible
    • Other interesting logs
  2. Configuration of the cluster and the task

    • tidb-lightning.toml for TiDB-Lightning if possible
    • tikv-importer.toml for TiKV-Importer if possible
    • topology.yml if deployed by TiUP
  3. Screenshot/exported-PDF of Grafana dashboard or metrics' graph in Prometheus if possible

tongtongyin avatar Mar 15 '21 01:03 tongtongyin

Do you have two tidb clusters A and B, have you performed the following sequence of operations?

  1. Start TiCDC of cluster A to copy data to cluster B
  2. A cluster performs full backup
  3. Insert some data in cluster A
  4. Restore the full backup data of step 2 in cluster B
  5. Perform incremental data recovery in cluster B (when was this incremental recovery data backed up from cluster A)

IANTHEREAL avatar Mar 17 '21 02:03 IANTHEREAL

According to What should I do when BR restores data to the upstream cluster of TiCDC/Drainer?, operations like is not supported yet.

cyliu0 avatar Mar 17 '21 02:03 cyliu0