mlcube icon indicating copy to clipboard operation
mlcube copied to clipboard
verified publisher icon mlcommons

Data Perf Beta [May 4th]

Open bitfort opened this issue 3 years ago • 2 comments

bitfort avatar Mar 30 '22 18:03 bitfort

  • Containerized the benchmarks from Alpha
  • Containers have to be runnable at home and on DynaBench 2.0. DB2.0 may not be ready by this point, but containers should be aligned with DB2.0 efforts
  • Needs to run on top of MLCube
  • [Nice to have] Users should be able to submit scores and have them show up on DynaBench. This may not be the focus of this taskforce, but the people involved will likely work on this

relja128 avatar Apr 06 '22 18:04 relja128

We didn't have external participants, Colby will test manually.

relja128 avatar May 04 '22 18:05 relja128