transformer-xl icon indicating copy to clipboard operation
transformer-xl copied to clipboard

Published 20 hours ago • verified publisher icon kimiyoung

Architecture for word-level Penn Treebank dataset

Open AlexGrinch opened this issue 6 years ago • 5 comments

Hello!

Can you, please, provide the bash script for training Transformer-XL on PTB dataset with PyTorch?

Thanks!

AlexGrinch avatar Jan 23 '19 23:01 AlexGrinch

+1 for this! Thanks

pclucas14 avatar Feb 18 '19 17:02 pclucas14

+1! It would be really helpful to have the script for PTB dataset! @kimiyoung

likicode avatar May 06 '19 20:05 likicode

Dear authors, Could you publish details of model super parameters for PTB word? Thanks

world2vec avatar Jun 16 '19 09:06 world2vec

We decided not to include our PTB code in this repo because we believe PTB, being super small, is mainly a regularization game and is somewhat misleading for the development of language modeling. That said, we will try to find time in the future to clean and release our code only for reproducing our results.

kimiyoung avatar Jun 16 '19 18:06 kimiyoung

@kimiyoung Did you mean that the reported score in the paper could not be reproducible?

sh0416 avatar Apr 20 '21 01:04 sh0416