drill icon indicating copy to clipboard operation
drill copied to clipboard

Commandline params for overwriting concurrency, iterations, etc.

Open WebeWizard opened this issue 3 years ago • 1 comments

I'd like to use this tool to benchmark a web service in the same way the popular TechEmpower benchmarks are performed.

"How is each test run?" Each test is executed as follows:

Restart the database servers.
Start the platform and framework using their start-up mechanisms.
Run a 5-second primer at 8 client-concurrency to verify that the server is in fact running. These results are not captured.
Run a 15-second warmup at 256 client-concurrency to allow lazy-initialization to execute and just-in-time compilation to run. These results are not captured.
Run a 15-second captured test for each of the concurrency levels (or iteration counts) exercised by the test type. Concurrency-variable test types are tested at 16, 32, 64, 128, 256, and 512 client-side concurrency. The high-concurrency plaintext test type is tested at 256, 1,024, 4,096, and 16,384 client-side concurrency.
Stop the platform and framework.

Is it possible to specify/overwrite a benchmark file's main properties (base URL, iterations, concurrency, etc) via command line parameters to avoid creating many nearly duplicate benchmark plan files?

WebeWizard avatar Feb 04 '21 00:02 WebeWizard

I have provided a pull request for the feature requested above. Looking forward to your feedback.

WebeWizard avatar Feb 10 '21 05:02 WebeWizard