Paulo Finardi

CHEATSHEET for ConvBERT?

6

Hi guys, impressive result with ConvBERT, there is any cheatsheet of how to train from scratch? Your BERT and ELECTRA cheatsheets are very helpful.

How Many HotWords

1

Hello! There is a golden interval for how many hotwords can I pass to the decode? 1000 is too much? I've fine-tuned a model in Portuguese language and I have...

@lonePatient great work! A simple question, is it possible train from scratch with your code? Thanks in advance!

Training in different Language

4

Hello enhuiz! Thank you for your work on developing this code. I used your Colab-notebook and everything ran perfectly. Do you think it is possible to train in another language,...