algorithmic-efficiency
algorithmic-efficiency copied to clipboard
Add code for self-reporting
Description
We need to check whether the user experience of self-reporting is clear and easy. This might require additional code or scripts to make self-reporting as easy as possible. It is worth thinking about exactly how we expect people to do this, particularly in the external tuning ruleset, but really in both.
See https://github.com/mlcommons/algorithmic-efficiency/pull/476#discussion_r1318012347
Added self-reporting instructions in getting started and script to package logs in https://github.com/mlcommons/algorithmic-efficiency/pull/657.
I suppose one remaining question is what medium we want to use to download logs?
Perhaps we can use the MLCommons Benchmarking Infra submission tool to allow submitters to upload the logs to as well.