algorithmic-efficiency icon indicating copy to clipboard operation
algorithmic-efficiency copied to clipboard

Add code for self-reporting

Open fsschneider opened this issue 1 year ago • 2 comments

Description

We need to check whether the user experience of self-reporting is clear and easy. This might require additional code or scripts to make self-reporting as easy as possible. It is worth thinking about exactly how we expect people to do this, particularly in the external tuning ruleset, but really in both.

See https://github.com/mlcommons/algorithmic-efficiency/pull/476#discussion_r1318012347

fsschneider avatar Oct 03 '23 09:10 fsschneider

Added self-reporting instructions in getting started and script to package logs in https://github.com/mlcommons/algorithmic-efficiency/pull/657.

I suppose one remaining question is what medium we want to use to download logs?

priyakasimbeg avatar Mar 05 '24 07:03 priyakasimbeg

Perhaps we can use the MLCommons Benchmarking Infra submission tool to allow submitters to upload the logs to as well.

priyakasimbeg avatar Mar 29 '24 00:03 priyakasimbeg