inference icon indicating copy to clipboard operation
inference copied to clipboard
verified publisher icon mlcommons

Loadgen needs to be updated to help support and enforce the no-sorting outside of the dataset rules for LLMs

Open pgmpablo157321 opened this issue 8 months ago • 0 comments

Options

  • [ ] Send the size of the original dataset to the SUT
  • [ ] Verification of the order that queries were responded by loadgen. Potentially introduce a new test for this.
  • [ ] Handle it in loadgen next

pgmpablo157321 avatar Apr 22 '25 19:04 pgmpablo157321