benchmarkstt icon indicating copy to clipboard operation
benchmarkstt copied to clipboard

Published 20 hours ago • verified publisher icon ebu

Group WER results by vendor

Open EyalLavi opened this issue 6 years ago • 1 comments

Should we return WER per vendor in addition to WER per transcript (#32)?

Consider:

  • The vendor information may not persist in the transcript
  • How to handle multiple hypothesis per vendor - do we simply average the WER?

EyalLavi avatar Feb 16 '19 20:02 EyalLavi

Decision in meeting today: place on the backlog for a future release.

EyalLavi avatar Feb 19 '19 13:02 EyalLavi