pytorch-transformer icon indicating copy to clipboard operation
pytorch-transformer copied to clipboard

Pytorch 트랜스포머 구현과 언어모델(BERT MLM, ELECTRA), 기계번역 테스트.

Results 2 pytorch-transformer issues
Sort by recently updated
recently updated
newest added

hey man, i got confused about the training process of the electra model, in my point, the generator should be trained first, but in your code, the generator and discriminator...

After adding **another dataset**, it works by increasing the max_length to 1150, then learning is good, but it does not work as an infer.