PQG-pytorch icon indicating copy to clipboard operation
PQG-pytorch copied to clipboard

Evaluate Code

Open Gary-code opened this issue 2 years ago • 5 comments

It seems like that after I trained the model with our own dataset using the code from master branch, I can not evaluate the model on the test set unless switching to ori- branch. However, I don't want to waste 2days training the model. What can I do to evaluate the testing data in the master branch.

Gary-code avatar Apr 14 '22 14:04 Gary-code

I check the code between the ori-code branch and the master branch. The checkpoint in the save model has a big difference. One save the encoder and generator. Another just simply save the model.

Gary-code avatar Apr 15 '22 01:04 Gary-code

In master branch you can use evaluate_scores function to evaluate on your own data, if you have saved your model then you just have to generate para phrases and then you can pass generated para phrase and ground truth to evaluate_scores function which will return the scores w.r.t. your ground truth in data and generated para phrases.

dev-chauhan avatar Apr 15 '22 11:04 dev-chauhan

Thanks a lot.

Gary-code avatar Apr 15 '22 12:04 Gary-code

Which model in the paper is the best. EDLPGS?

Gary-code avatar Apr 20 '22 02:04 Gary-code

Its EDLPS in terms of Bleu scores

dev-chauhan avatar Apr 20 '22 22:04 dev-chauhan