inference
inference copied to clipboard
Some questions regarding the maintainability of MLPerf inference benchmarks
The below questions are not documented anywhere AFAIK. It'll be good to clarify these.
| Benchmark | Responsible Maintainer | Run support duration | Code improvements welcome? |
|---|---|---|---|
| Submitted Results | Submitter or Inference WG? | ? | No? |
| Reference Implementations | Inference WG ? | Until a benchmark is retired or some months after the retirement? | Yes? |