serge icon indicating copy to clipboard operation
serge copied to clipboard
verified publisher icon serge-chat

🚀 [Feature]: Add support for Llama 3.1 Models

Open rohitashwin opened this issue 1 year ago • 2 comments

Feature Description

Add support for Llama 3.1 8B, 70B, and if possible 405B models.

Additional Context (optional)

No response

Checklist:

  • [X] I have checked for existing issues that describe my suggestion prior to opening this one.
  • [X] I understand that improperly formatted feature requests may be closed without explanation.

rohitashwin avatar Jul 23 '24 21:07 rohitashwin

@rohitashwin PR's are welcome

gaby avatar Jul 27 '24 18:07 gaby

Blocked by https://github.com/abetlen/llama-cpp-python/issues/1625 and https://github.com/abetlen/llama-cpp-python/issues/1618

gaby avatar Jul 27 '24 19:07 gaby