ggml icon indicating copy to clipboard operation
ggml copied to clipboard
verified publisher icon ggml-org

NLLB-200 support

Open kaspar030 opened this issue 2 years ago • 4 comments

It would be great to have ggml support for Facebook's No Language Left Behind 200x200 translation model:

https://ai.facebook.com/research/no-language-left-behind/

https://huggingface.co/facebook/nllb-200-3.3B

kaspar030 avatar May 08 '23 21:05 kaspar030

NLLB-200 is a great model. It would be wonderful if GGML could support this model.

zhangp365 avatar Oct 18 '23 08:10 zhangp365

Yes, I would also like to use ggml for inferencing nllb models. @ggerganov Is conversion/inference possible as of today? If not any ETA?

bil-ash avatar Oct 22 '23 03:10 bil-ash

Try looking for community help in llama.cpp - we've already implemented several architectures there

ggerganov avatar Oct 22 '23 10:10 ggerganov