tiflow icon indicating copy to clipboard operation
tiflow copied to clipboard

CDC scan speed metric not accurate

Open fubinzh opened this issue 1 year ago • 2 comments

What did you do?

  1. Change TiKV configuration
cdc.incremental-fetch-speed-limit= 256MiB (default 512MiB)
cdc.incremental-scan-speed-limit = 64MiB (default 128MiB)
  1. Create CDC changefeed
  2. Pause the changefeed
  3. Run workload for a long time e.g. 24H
  4. Resume changefeed

What did you expect to see?

CDC metrcis should be accurate.

What did you see instead?

The metrics CDC scan speed below actually corresponding to cdc.incremental-fetch-speed-limit. image

Versions of the cluster

bash-5.1# /cdc version Release Version: v6.5.3-20231116-255d810 Git Commit Hash: 255d8104c8b9b4f8af191ee69d301ced723ccc3d Git Branch: heads/refs/tags/v6.5.3-20231116-255d810 UTC Build Time: 2023-11-16 06:35:28 Go Version: go version go1.19.12 linux/amd64 Failpoint Build: false

fubinzh avatar Nov 17 '23 10:11 fubinzh

/severity moderate

fubinzh avatar Nov 17 '23 10:11 fubinzh

@hicqu could please take look at this issue? Thank you~!

asddongmen avatar Jan 20 '24 01:01 asddongmen