databend-perf
databend-perf copied to clipboard
take bendctl to replace perf-tool
now we have got the cli to access our cloud platform bendctl
, we can consider replacing the cli perf-tool to bendctl.
the problems with perf-tool:
- the test logic is hard coded inside the cli tool, hard to customize the test logic by python script.
- the api client is manual written and have some adhoc logic inside, it does not handle some corner cases like 520 well.
- hard to reproduce the failed case on desktop.
the pros about bendctl:
- allowing us seperate the api client logic with the test workflow logic (like run each query 10 times for ontime dataset)
- have a more stable fundation about the api access logic like session management, warehouse management, retry, etc.
https://github.com/datafuselabs/databend-perf/pull/110 replaces the reload part into bendctl.
we can further replace the benchmark part into bendctl.