inference icon indicating copy to clipboard operation
inference copied to clipboard

Disambiguating execution modes

Open rajesh-s opened this issue 1 year ago • 1 comments

What are the difference between the test and valid modes list on the documentation?

Since this is intended to be a reproducible bechmark suite, would it be possible to add clear instructions on which modes are to be run and the impact each step has? For instance, I cannot tell if the test execution mode is optional or if it is generating a target metric (as indicated by "record the estimated offline_target_qps" on the documentation)

rajesh-s avatar Aug 27 '24 17:08 rajesh-s