llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Feature Request: Ovis1.5-Gemma2-9B model support?

Open liuzl opened this issue 1 year ago • 1 comments

Prerequisites

  • [X] I am running the latest code. Mention the version if possible as well.
  • [X] I carefully followed the README.md.
  • [X] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
  • [X] I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

Add support for the Ovis1.5-Gemma2-9B model in llama.cpp.

Motivation

It would be highly beneficial if this model could be made compatible with GGUF, similar to how LLaVA is supported. In my experience, this model has performed exceptionally well.

Possible Implementation

No response

liuzl avatar Aug 09 '24 07:08 liuzl

https://huggingface.co/AIDC-AI/Ovis1.5-Gemma2-9B

liuzl avatar Aug 09 '24 07:08 liuzl

This issue was closed because it has been inactive for 14 days since being marked as stale.

github-actions[bot] avatar Sep 24 '24 01:09 github-actions[bot]

bump

Technetium1 avatar Sep 24 '24 05:09 Technetium1