xlnet-Pytorch icon indicating copy to clipboard operation
xlnet-Pytorch copied to clipboard

Published 20 hours ago • verified publisher icon graykode

Reimplement training time and the performance on each task?

Open Zzmonica opened this issue 5 years ago • 5 comments

As mentioned above.

Zzmonica avatar Jul 06 '19 06:07 Zzmonica

Pre-training is Yes. But fine-tuning task is not Yet

graykode avatar Jul 08 '19 15:07 graykode

the q/k/v wrong!!

yuanjungod avatar Jul 17 '19 05:07 yuanjungod

the q/k/v wrong!!

can u point out where the wrong code is? I compared this IMPL with ZihangDai'IMPL and didn't find anything wrong.

xingchensong avatar Jul 31 '19 06:07 xingchensong

@graykode Hi~ GREAT THX for ur Pytorch IMPL of XLNet, I wonder whether u have a plan to impl fine-tuning part in pytorch?

xingchensong avatar Jul 31 '19 07:07 xingchensong

@yuanjungod Could you tell me where is wrong point?? @xingchensong Thanks for your interest in my project. !! No not yet huggingface already did it! https://github.com/huggingface/transformers < in here You can see more easiliy as thought this project is shown about simple implementation such as how XLNet pre-training and pre-processing Thanks!

graykode avatar Sep 29 '19 06:09 graykode