electra_pytorch icon indicating copy to clipboard operation
electra_pytorch copied to clipboard

verified publisher icon richarddwang
→

Metadata

Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)

Results 5 electra_pytorch issues
Sort by recently updated
recently updated
newest added

bug: fix accuracy metric and add `test_with_y=True`

Hi there! Thank you so much for your work on this project. I was using your script to finetune ELECTRA on a smaller dataset and noticed that the `learner` was...

EllingtonKirby avatar EllingtonKirby

Restarting from previous checkpoint

Hi, do you know what the best way to resume training from a previous checkpoint would be? Let's assume I am training for 100k steps but I have a 24-hour...

jbrry avatar jbrry

Python version

Hi @richarddwang, What version of python did you test this on? Thanks, Alex

alexpancheva avatar alexpancheva

License info is required

Hi, there. Where is your LICENSE preferences? Please add them.

Ab1992ao avatar Ab1992ao

Learner class missing?

Sorry if I am overlooking something here, but where is the Learner class imported or defined which is used in line 388 in the pretrain.py script? Many thanks!

RalfKellner avatar RalfKellner

← Metadata

321
Stars
41
Forks
Watchers

Owner

verified publisher icon richarddwang

Metadata

Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)

Back