CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard

Published 20 hours ago • verified publisher icon OpenNMT

adopt modern bert please!

Open BBC-Esq opened this issue 11 months ago • 1 comments

New model architecture that should be up ctranslate2's alley!

https://huggingface.co/docs/transformers/main/en/model_doc/modernbert

Apparently, transformers.js has already adopted it...let's do this!

https://github.com/huggingface/transformers.js/pull/1104

BBC-Esq avatar Dec 19 '24 17:12 BBC-Esq

Some additional links to models just released:

https://huggingface.co/answerdotai/ModernBERT-large https://huggingface.co/answerdotai/ModernBERT-base https://huggingface.co/blog/modernbert

BBC-Esq avatar Dec 20 '24 11:12 BBC-Esq