mobile_app_open icon indicating copy to clipboard operation
mobile_app_open copied to clipboard
verified publisher icon mlcommons

LLM IFEval Dataset Implementation

Open farook-edev opened this issue 5 months ago • 14 comments

Things left to do on this dataset are as follows:

  • [x] Finish code to convert data to .tfrecord
  • [x] Finish code to handle sending and receiving data.
  • [x] Review Instruction validation code (possibly against existing implementation).
  • [x] Test Accuracy and Performance metrics.
  • [x] Potentially move accuracy calculation away from output processing (similar suggestion in TinyMMLU)

farook-edev avatar Oct 02 '25 00:10 farook-edev