pytorch-transformer
pytorch-transformer copied to clipboard
Pytorch 트랜스포머 구현과 언어모델(BERT MLM, ELECTRA), 기계번역 테스트.
Results
2
pytorch-transformer issues
Sort by
recently updated
recently updated
newest added
hey man, i got confused about the training process of the electra model, in my point, the generator should be trained first, but in your code, the generator and discriminator...
After adding **another dataset**, it works by increasing the max_length to 1150, then learning is good, but it does not work as an infer.