christ1ne

My understanding is that you just need to set a number which is a reasonable for your HW. The final reported performance numbers will be from the logs.

WG: - concerns: self-reporting will lead to messy outcome - objective should be define the efforts required to produce this result - please add your thoughts offline to this issue....

WG: need a specific example AR: @christ1ne

[precision_example.xlsx](https://github.com/mlcommons/inference_policies/files/5868435/precision_example.xlsx) @DilipSequeira please let me know what you think? This precision info is from the json in the measurement directories.

We allow all numerics but we should have a good list to take care of different capitalization, naming nuances.

WG: concerns: 1. symbols are hard to work with in a numerics table. 2. The list of precision choices could be hard to determine. -> we can defer the list...

**Proposal:** - what? For datacenter only & for R50, SSD-R34 and 3D UNET: input is now jpeg images, output is the same as before. - when? TBD

- need to consider if that will further narrow the pool of potential submitters - better to get use case from the vision advisory board - will hear from David's...

WG: will update with survey results next week. If no consensus from submitters, we will rely on the future vision advisory board. Scott suggested another end-to-end benchmark to track the...

@TheKanter will follow up on data center specific submitters.