databend-perf icon indicating copy to clipboard operation
databend-perf copied to clipboard

take bendctl to replace perf-tool

Open flaneur2020 opened this issue 2 years ago • 1 comments

now we have got the cli to access our cloud platform bendctl, we can consider replacing the cli perf-tool to bendctl.

the problems with perf-tool:

  • the test logic is hard coded inside the cli tool, hard to customize the test logic by python script.
  • the api client is manual written and have some adhoc logic inside, it does not handle some corner cases like 520 well.
  • hard to reproduce the failed case on desktop.

the pros about bendctl:

  • allowing us seperate the api client logic with the test workflow logic (like run each query 10 times for ontime dataset)
  • have a more stable fundation about the api access logic like session management, warehouse management, retry, etc.

flaneur2020 avatar Aug 23 '22 04:08 flaneur2020

https://github.com/datafuselabs/databend-perf/pull/110 replaces the reload part into bendctl.

we can further replace the benchmark part into bendctl.

flaneur2020 avatar Aug 30 '22 10:08 flaneur2020