fubinzh

[Kafka Consumer Issue] Data inconsistency seen after CDC scale

4

### What did you do? 1. deploy TiDB cluster with 1 cdc node, create kafka changefeed, and run kafka consumer to consumer kafka message a MySQL. ``` cdc cli changefeed...

The resolvedTs of a changefeed get stuck during initialization if there are more than 400k resolvedTs per second sending from upstream.

4

### What did you do? 1. TiDB cluster with 8.1 TiKV and 7.5 CDC 2. create kafka simple protocol changefeed 3. no workload running ### What did you expect to...

CDC resolved ts and checkpoint lag unstable and up to 2min

3

### What did you do? 1. Deploy TiDB cluster with 2 CDC nodes (16c32g) 2. Create kafka simple protocol changefeed 3. Run workload for 4k tables (row width: 1.8k, cdc...

storage.io-rate-limit max-bytes-per-sec doesn't work perfectly

3

## Bug Report ### What version of TiKV are you using? v8.0 ### What operating system and CPU are you using? x86, k8s ### Steps to reproduce 1. TiDB cluster...

slow store during TiKV scale out, and CDC lag up to 15s

5

## Bug Report ### What version of TiKV are you using? ``` [2024/03/14 13:06:52.475 +00:00] [INFO] [lib.rs:95] ["Release Version: 8.0.0-alpha"] [thread_id=1] [2024/03/14 13:06:52.475 +00:00] [INFO] [lib.rs:95] ["Edition: Community"] [thread_id=1] [2024/03/14...

PITR checkpoint doesn't move forward during one TiKV and PD leader network partition

3

## Bug Report ### What version of TiKV are you using? v6.3.0 ### What operating system and CPU are you using? K8S ### Steps to reproduce 1. Start PITR log...

TiKV min resolved ts lag up to 30s during tikv rolling restart, resulting in cdc lag increase

4

## Bug Report ### What version of TiKV are you using? 8.0.0-alpha, 1c7b34419feaf8901046df335d4da55ad3ca9b5d ### What operating system and CPU are you using? X86, K8S ### Steps to reproduce 1. TiDB...

CDC consumes too much cpu, and lag goes up from 2s to 4s every few hours

1

### What did you do? 1. TiDB cluster with 2 CDC nodes (24c32g) cdc config: ``` config: | log-file = "/var/lib/ticdc/log/ticdc.log" [debug] [debug.kv-client] frontier-concurrent = 32 ``` TiKV cdc.min-ts-interval =...

resolved ts stuck for 10m when TiKV failure restored.

5

## Bug Report ### What version of TiKV are you using? v8.0 git_hash: 9f51dfed1f04224a746facfbd919ae8ebec639eb ### What operating system and CPU are you using? X86, K8S ### Steps to reproduce 1....

runtime error: slice bounds out of range when exec prepared statement with leading newline

3

## Bug Report Please answer these questions before submitting your issue. Thanks! ### 1. Minimal reproduce step (Required) Run below sql ``` create database if not exists test; use test;...