sacrerouge
sacrerouge copied to clipboard
danieldeutsch
SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
Hi, I am trying to setup sacrerouge on Windows, but it can't recognize sacrerouge command when running ''sacrerouge setup-metric meteor". Is there a way of install each metric dependencies on...
Add documentation for the stat sig test command: https://github.com/danieldeutsch/sacrerouge/blob/master/sacrerouge/commands/stat_sig_test.py
If a metric is not installed (e.g., a metric like `MoverScore` might not have the necessary pip packages installed, and therefore will not work), the metric-specific command gives a really...
The code to run evaluate and score is duplicated. It appears in both `evaluate.py`, `score.py`, and `metric_command.py`. This should be consolidated into two functions (one for evaluate, one for score)...
As a consequence of #35, the BEwT-E unit tests are disabled on Github. We should debug why it fails on Github and fix it. To repro the failure, remove the...
The original ROUGE script allows for a scoring option: `-f A|B` where `A` means to average over the models and `B` takes the maximum. Similar functionality should be implemented for...
Metadata
Owner
Metadata
SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.