Anton Lokhmotov
Anton Lokhmotov
@dalvikus Please clarify.
Notable examples in v3.0 and v3.1 include CPU-only submissions with names `1-node-2S-SPR-PyTorch-INT8` and `1-node-2S-SPR-PyTorch-MIX`, which could be folded into the same row. On the other hand, `1-node-2S-SPR-PyTorch-INT4+INT8` and `1-node-2S-SPRHBM-PyTorch-BF16` could...
I totally agree that ML != DL, but do you have any data on how widely these models are used in production?
This issue has been open for 1.5 years. Let's close it?
@peladodigital Can this be merged please?
> A binary component is _Reproducible_ if it is downloadable by anyone to whom the hardware is Available, > from a URL which must remain valid until a release of...
Currently, the checker asks to have `mlperf_log_accuracy.json` for performance runs as well. Is this intended?
The rules actually mention `__.json` in the [title](https://github.com/mlperf/policies/blob/master/submission_rules.adoc#57-system_desc_id_implementation_id_scenariojson-metadata), as `_.json` in the text of that section. It seems that `_` is superfluous here? Furthermore, no examples are provided (`[ TODO...
Thanks @guschmue. I'm still not clear what `implementation_id` is. For the `code/` subdir, I had to set it to `task+'_'+scenario`, where `task` is `image-classification` or `object-detection`, to make the checker...
Thanks @guschmue, I think I get it now. Do you have structure like this then: ``` code/ mobilenet/ reference/ README.md resnet/ reference/ README.md ... ``` where each `README.md` is identical?...