benchmark

benchmark copied to clipboard

When testing against SaaS providers, benchmark setup can take quite a bit of time. If actions such as topic creation are artificially throttled it can take upwards of 20 minutes to create hundreds of topics, consumers, etc.

In order to support this, the HTTP worker timeouts (read/request) should be configurable.

The line with hardcoded timeout is here: https://github.com/openmessaging/benchmark/blob/fe3c5a0c4a35997ccc94c1b0e0fc23797ed516db/benchmark-framework/src/main/java/io/openmessaging/benchmark/worker/HttpWorkerClient.java#L61

The workers creating the topics could periodically return a status and the benchmark orchestrator could timeout upon missing a few status updates, but the low hanging fruit would be making these values configurable.