inference icon indicating copy to clipboard operation
inference copied to clipboard

Cleanup/Alignment of submission structure

Open pgmpablo157321 opened this issue 8 months ago • 1 comments

  • The submission directory has five specified directories, and these remain sufficient to organize the necessary data (“A submission should take the form of a directory with the following structure. The structure must be followed…”). For many rounds however, vendor harnesses have unnecessarily expanded far beyond this structure with vendor-specific scripts, config details, environment, and documentation. Though the original intent may have been benign, the result is to make one vendor ubiquitously represented across nearly all submitter content (see image below) and to clutter the defined structure.
  • There are several potential solutions to alleviate such concerns. However the most straight-forward are:
    • As the code is nearly identical across OEMs, the vendors need only reference the original vendor code. This is the existing Intel approach.
    • A vendor can create a dir such as ‘{SUBMITTER}/code/nv_harness’ to contain all the extra content currently residing in the ‘{SUBMITTER} dir.
  • In the case where harness-specific documentation is replicated in OEM ‘common’ locations (ex. here or here), name files in such a way that the scope is clear (ie. calibration.md -> calibration.nv.md or nv/calibration.md).
  • This issue was initiated in v4.1 post-mortem, but tabled with plans of offline resolution. No further action has been taken.
Image

Post mortem task proposed by @keithachorn-intel

pgmpablo157321 avatar Apr 22 '25 23:04 pgmpablo157321

PR created to highlight the intent of aligning to the outlined directory structure.

keithachorn-intel avatar May 27 '25 07:05 keithachorn-intel

Closing since the discussion has moved to policies#195

hanyunfan avatar Oct 06 '25 16:10 hanyunfan