mlx-examples icon indicating copy to clipboard operation
mlx-examples copied to clipboard

Support for nanogpt (and gpt-j)

Open uogbuji opened this issue 1 year ago • 0 comments

I'm hoping to use MLX-LM to try out inference with this new LM specialized for Nigerian languages. It's based on Karpathy's nanogpt (they say it's inspired by GPT-J's architecture—I suspect inferencing over base nanogpt would work). As expected looking at the supported model types list, core MLX doesn't support that. I also see the separate nanoGPT_mlx, but looks like work really slowed down on that.

Supporting a Nigerian language LLM would be a really nice nod to the global south (it includes Pidgin, which is widely spoken in Africa). I think it would also bring a lot of interest to MLX for fast inference as this model develops.

uogbuji avatar Jul 19 '24 14:07 uogbuji