llama.cpp
llama.cpp copied to clipboard
Feature Request: support for Gemini Nano?
Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the README.md.
- [X] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
- [X] I reviewed the Discussions, and have a new and useful enhancement to share.
Feature Description
Adding support for Google's Gemini Nano.
- It's a 1.9Gb multi-modal model.
- Google promo page
- Huggingface
Motivation
Google's Gemini Nano model is seeing some uptake, with not just Chrome browsers, but also Samsung Galaxy smartphones adopting it. This might make it useful to adopt the model in other contexts too, to allow for similar experiences.
Possible Implementation
No response