lm-question-generation icon indicating copy to clipboard operation
lm-question-generation copied to clipboard

I have this error

Open nhatmin2002 opened this issue 1 year ago • 5 comments

nhatmin2002 avatar Aug 22 '23 14:08 nhatmin2002

raceback (most recent call last): File "/usr/local/bin/lmqg-eval", line 8, in sys.exit(main()) File "/usr/local/lib/python3.10/dist-packages/lmqg/lmqg_cl/model_evaluation.py", line 50, in main metric = evaluate( File "/usr/local/lib/python3.10/dist-packages/lmqg/automatic_evaluation.py", line 291, in evaluate metric[_split] = get_metric(_split, _hypothesis_file, None) File "/usr/local/lib/python3.10/dist-packages/lmqg/automatic_evaluation.py", line 272, in get_metric metric = compute_metrics( File "/usr/local/lib/python3.10/dist-packages/lmqg/automatic_evaluation.py", line 148, in compute_metrics score, scores = scorer.compute_score(gts, res_filtered) File "/usr/local/lib/python3.10/dist-packages/lmqg/automatic_evaluation_tool/meteor/meteor.py", line 116, in compute_score stat = self._stat(hypo, gts[i]) File "/usr/local/lib/python3.10/dist-packages/lmqg/automatic_evaluation_tool/meteor/meteor.py", line 150, in _stat self.meteor_p.stdin.flush() BrokenPipeError: [Errno 32] Broken pipe

nhatmin2002 avatar Aug 22 '23 14:08 nhatmin2002

when run !lmqg-eval -m "/content/drive/MyDrive/testmodel/lmqg_output/t5-small-squad-ae/model_rcgffo/epoch_4" -e "/content/eval_metrics" -d "lmqg/qg_squad" -l "en" --max-length 256

nhatmin2002 avatar Aug 22 '23 14:08 nhatmin2002

Can you help me please

nhatmin2002 avatar Aug 22 '23 14:08 nhatmin2002

No description provided.

nhatmin2002 avatar Aug 23 '23 12:08 nhatmin2002

Hi, I actually have the error BrokenPipeError: [Errno 32] Broken pipe in one of my server, and I am not sure why it happens on some specific machines. For sure that it's caused by the JAVA software to compute METEOR metric, so I will perhaps consider to change the implementation to something else, to make it free from JAVA.

asahi417 avatar Nov 07 '23 22:11 asahi417