CharlesCheung996
CharlesCheung996
### What problem does this PR solve? Issue Number: close #11216 ### What is changed and how it works? 1. Move [AddTableBatchSize](https://github.com/pingcap/tiflow/pull/11197/files#diff-5efe37006daf176ecbb4df807539f64719314947957f5b78bb4bd3453c2ab881R47) from server to changefeed config. 2. Add [MaxTableCount](https://github.com/pingcap/tiflow/pull/11197/files#diff-46d391757d5e8384d6854c28080c8eb981dd84f96bdb317da51ad9c6bf7c1c5fR115-R122)...
# Background When using the index-value or columns [dispatcher](https://docs.pingcap.com/tidb/stable/ticdc-sink-to-kafka#customize-the-rules-for-topic-and-partition-dispatchers-of-kafka-sink:~:text=Tables%20in%20the%20test1%20table%20use%20the%20index,columns%20does%20not%20exist%2C%20an%20error%20is%20reported.) to distribute data across different Kafka partitions based on the key, multiple consumer processes in the downstream consumer group consume Kafka...
1. Create a changefeed which synchronize 150k tables. 2. The schedule has not been completed in 40 minutes. 
### What problem does this PR solve? Issue Number: close #xxx ### What is changed and how it works? ### Check List #### Tests - Unit test - Integration test...
### First-time contributors' checklist - [ ] I've signed [**Contributor License Agreement**](https://cla-assistant.io/pingcap/docs-cn) that's required for repo owners to accept my contribution. ### What is changed, added or deleted? (Required) ###...
use pool
### What problem does this PR solve? Issue Number: close #xxx ### What is changed and how it works? ### Check List #### Tests - Unit test - Integration test...
### What problem does this PR solve? Issue Number: close #xxx ### What is changed and how it works? ### Check List #### Tests - Integration test - Manual test...