summac

summac copied to clipboard

What is the range for scores computed by both methods? I saw in another post that, evaluation score by SummaC-ZS is from [-1, 1] or [0, 1] depending on the...

qye-supplyframe

Hi, I am currently writing a thesis based on the summac model. But I find that the author deleted it. So I want to ask if someone downloaded it, could...

QianNetherladns

Fix bugs in initializing `self.cnndm` in `benchmark.py`

1

**Critical change**: Below, lines 44 and 54 can cause an error due to `CNNDM` is undefined. And there is no need for the global variable `CNNDM` when `self.cnndm` presents. This...

forrestbao

torch throws a warning about creating a tensor from a list of arrays: ``` summac/model_summac.py:301: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting...

tomhosking

Loading the underlying NLI model from HF prints `` - this PR hides the message if all keys matched successfully to avoid unnecessary output.

tomhosking

 where is your utils_summac_benchmark? Not from your code, and not from pip install.

yaokunkun

Pip install fails on multiple python versions (Ubuntu)

3

I tried multiple python versions but keep running into compatibility issues across the different required libraries: ERROR: pip's dependency resolver does not currently take into account all the packages that...

simonhughes22

Issue pip package install with python version 3.10

5

Hi, thanks for providing the project as a pip package! The installation doesn't work on python 3.10 for me. Anybody gotten the same experience? I can circumvent the issue by...

UntotaufUrlaub

Hi, I encountered an error: ``` File "/add_score.py", line 53, in add_score res = function(["? I haven't had a birthday since 2007. I have a b-day in October and it's...

UntotaufUrlaub

How to interpret negative scores produced by SummaCzs

2

I got negative scores from SummaCzs model following the example usage with my data. For example, scores look like the following. ``` "scores": { "for_reference_summary": [ -0.193, -0.746 ], "for_generated_summary":...

chris-opendata