Pre-training proplexity

[tryanbot]

hi, I wanna ask about the training dairy/behaviour. do you have notes on it? or at least the number of the final proplexity for each of the bert types. It will be helpful for the research community to reproduce your research. thanks