optimum-benchmark icon indicating copy to clipboard operation
optimum-benchmark copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Evaluators for specific tasks

Open IlyasMoutawwakil opened this issue 10 months ago • 5 comments

@regisss would it make sense to add task specific evaluators. for example with automatic-speech-recognition, as I did it manually when I did whisper's benchmark.

IlyasMoutawwakil avatar Aug 21 '23 07:08 IlyasMoutawwakil