Make simulator Great Again!

[HuSharp]

Development Task

• Currently, we have many components to simulate the interaction with pd, pd-api-bench, pd-tso-bench, pd-heartbeat-bench, pd-simulator. We can integrate them step by step, with lower learning costs and easier interaction testing of various pd's.
  • Enhance simulator to support 1000w regions and 300 stores
    • #8215
    • #8220
    • #5677
    • #8245
    • #8246
    • #8257
    • #8269
    • #8304
    • #8318
    • #8376
    • TODO:
      • add rules case
  • Enhance heartbeat bench for daily regression testing
    • #8235
  • Enhance tso bench
    • #7756
• After that we can provide pd the same specification machine to deploy the real pd under the big cluster, simulate the request number of TiDB/TiKV + TiKV heartbeat heartbeat report + all kinds of scheduling for the region and so on.
  • #8140

mock TiKV data to archive the following goals:

• can balance region...
• can support three forms node: meta-node/simulator(simple raft)/real-tikv
• support unified interface to interact with real-tikv

mock TiDB&TiKV API

existed tool usages like

./bin/pd-api-bench -http-cases GetRegionStatus-1+1,GetMinResolvedTS-1+1 -client 1 -debug true

mock TiKV heartbeat/TSO

existed tool usages like ./bin/pd-heartbeat-bench --config=./tools/pd-heartbeat-bench/config-template.toml --pd-endpoints http://127.0.0.1:2379

Others

• support front operator

Related

• integration simulator tools #8140

#5468 extend simulator #6922 extend API bench