Ashwin Nanjappa
Ashwin Nanjappa
https://github.com/mlcommons/inference_policies/blob/master/inference_rules.adoc#412-relaxed-constraints-for-the-open-division Rule 2 states that: > The accuracy dataset must be the same as used in an existing Closed benchmark, or must be pre-approved and added to the following list:...
Neither the `/inference` or the `/inference_policies` repo holds the submission UI usage documentation that Pablo had created and added into the private 2.0 submission repo. Could we pull that markdown...
Note that this does not change the rule. This PR only clarifies the Preview HW rules by rewording since we found the current wording as confusing. If folks would like...
We have already enabled TEST01 for SDXL - wasn't mandatory for v4.0 (because the proposal came late), but mandatory for v4.1. https://github.com/mlcommons/inference/pull/1574 NVIDIA has checked internally and SDXL can be...