next_word_prediction icon indicating copy to clipboard operation
next_word_prediction copied to clipboard

model taking so much time on loading, i want to reduce it for deployment purpose.

Open Deepakchawla opened this issue 4 years ago • 1 comments

Deepakchawla avatar Dec 26 '20 19:12 Deepakchawla

Can just use bert-base-uncased, comment out/ remove other models. In my tests, bert(500M?) is good enough to use.

dongyuwei avatar Apr 08 '24 13:04 dongyuwei