mlcommons
Consolidate dir structure
After v4.1 we removed legacy ‘calibration’ dir because it was no longer valued (usurped by code dir). There continue to be three largely overlapping dirs which are inconvenient to navigate and only separated due to legacy (not utility): compliance, measurements, results. Due to common structure, these can be easily merged as follows. Simplifying the dir structure will reduce common difficulties, merge complications, and especially error debugging from submission checker (frequent vague errors due to misnaming and missing files):
Post mortem task proposed by @keithachorn-intel
PR created to consolidate Results/Measurements/Compliance into 'Results' dir.
@pgmpablo157321 - The directories for compliance and measurements are set here and reused only as variables:
- Compliance
- Measurements: here and here
Would updating these two to match the results_dir be sufficient, or do other tools need to be updated also? Perhaps for a transitionary cycle, adding a check whether the original dirs exist first before defaulting to results_dir would cover that case.