Benchmarking Question List #1

[Agalakdak]

Hello everyone. I have been using MLperf benchmarks for some time. And I have a small list of questions about them. I am asking them here because I have not found answers in other sources of information.

1. I have several video cards in my system. Can I explicitly set the number of video cards for the test?

2. This question follows from the question above. Do all tests use all available GPUs?

3. Many tests have different profiles like "edge" "datacenter" what is the difference between them?

4. Since the space on my SSD is limited, how can I tell the benchmarks to use a different directory to store the cache?

5. The tests (in the profiles that I used) do not always use 100% of the video memory. Are there any scenarios for which all the video memory will be used or is this not necessary?

6. Perhaps there are more subtle benchmark settings, is there any user guide.