controllable-text-attribute-transfer icon indicating copy to clipboard operation
controllable-text-attribute-transfer copied to clipboard

Published 20 hours ago • verified publisher icon Nrgeup

How to get BLEU score?

Open kinggodhj opened this issue 4 years ago • 1 comments

Hi I'm trying to reproduce your work about YELP dataset. However, the BLEU score that i've gotten is quite different.

I trained the model 200 times and got the score from your multi-bleu.py file. (Hypothesis-transferred sentences from model reference-human.txt file) The score was 5.07. It's quite low. So how did you get the score 24.6? Could you let me know settings you've done?

kinggodhj avatar Mar 06 '20 06:03 kinggodhj

Sorry to reply to you so late! I provided the outputs in https://github.com/Nrgeup/controllable-text-attribute-transfer/tree/master/outputs, or you can use the checkpoints I provided in https://github.com/Nrgeup/controllable-text-attribute-transfer/tree/master/method/mymodel-/save//***.pkl to generate outputs.

Nrgeup avatar Mar 18 '21 10:03 Nrgeup