inference
inference copied to clipboard
Disambiguating execution modes
What are the difference between the test and valid modes list on the documentation?
Since this is intended to be a reproducible bechmark suite, would it be possible to add clear instructions on which modes are to be run and the impact each step has? For instance, I cannot tell if the test execution mode is optional or if it is generating a target metric (as indicated by "record the estimated offline_target_qps" on the documentation)