sacrerouge

sacrerouge copied to clipboard

AttributeError: readonly attribute when trying to do - sacrerouge setup-metric rouge

3

More information : ``` Traceback (most recent call last): File "/Users/sriharshahatwar/miniconda3/envs/bylineextraction/bin/sacrerouge", line 8, in sys.exit(main()) File "/Users/sriharshahatwar/miniconda3/envs/bylineextraction/lib/python3.10/site-packages/sacrerouge/__main__.py", line 5, in main parser = build_argument_parser() File "/Users/sriharshahatwar/miniconda3/envs/bylineextraction/lib/python3.10/site-packages/sacrerouge/arguments.py", line 10, in build_argument_parser...

Sriharsha-hatwar

Old URL for the question generation model in QA eval

2

Hi @danieldeutsch, Thank you for building this very useful library. I wanted to point out a small bug that I found while using the QAEval metric. I think the URL...

martiansideofthemoon

# Patching CVE-2007-4559 Hi, we are security researchers from the Advanced Research Center at [Trellix](https://www.trellix.com). We have began a campaign to patch a widespread bug named CVE-2007-4559. CVE-2007-4559 is a...

TrellixVulnTeam

Rouge-L in python interface?

1

Hi Daniel, Kudos to the wonderful pacakge! I wonder how to use Rouge-L under the python interface, i.e. the example you shown in the tutorial. Thanks!

serenayj

Evaluate on multiple gpus

3

Thanks for making easily available all metrics for summarization! Some metrics (e.g QAGS, QAEval) are a bit heavy to run and it'd be great if we can parallelize the evaluation...

ariecattan

Problem with setup for qaeval

1

Hi there, I have a problem setup qaeval. When I run `sacrerouge setup-metric qa-eval`, it always shows ``` Traceback (most recent call last): File "/net/nfs.cs/s2-research/wenx/miniconda3/envs/qaeval2/bin/sacrerouge", line 8, in sys.exit(main()) File...

Wendy-Xiao

The correlations on the QAGS dataset are near 0, so there is likely some error (either here or with the QAGS data). I do not know what yet.

danieldeutsch

Adds a wrapper around the QAGS metric. The correlations currently do not reproduce the paper's results and the scores are non-deterministic.

danieldeutsch

During the correlation calculation, multiple metrics objects are merged into one https://github.com/danieldeutsch/sacrerouge/blob/f1a864cd8b89542466f50315b249e532c3d0ca9a/sacrerouge/commands/correlate.py#L34-L38 If someone calls correlate multiple times in a row, it will mess up the results. This should not...

danieldeutsch

This PR seeks to add other major platforms (OS X and Windows) to CI. In doing so, it will also fix issues that arise by doing so. 😄 This is...

erip