augpt

augpt copied to clipboard

Results with public checkpoints

10

Running the evaluation in the following fashion: ``` ./generate.py --model jkulhanek/augpt-mw-21 --dataset multiwoz-2.1-test --file predictions.txt ./evaluate_multiwoz.py --file predictions.txt --dataset multiwoz-2.1-test ``` I get inform and success results somewhat lower than...

YovaKem

Perhaps the data version should not be hardcoded [here](https://github.com/ufal/augpt/blob/fa8a57961ed1d8fe6099978c489c0b0f8956d64e/train_multiwoz.py#L43) in case one is training on MultiWOZ 2.0.

YovaKem

Faulty import

1

I believe that [this line ](https://github.com/ufal/augpt/blob/fa8a57961ed1d8fe6099978c489c0b0f8956d64e/train_multiwoz.py#L13) can be safely commented out as it seems to serve no purpose and the import doesn't work.

YovaKem