OpenAdapt
OpenAdapt copied to clipboard
Implement Nous-Hermes-13b
Feature request
We want to get completions using https://huggingface.co/NousResearch/Nous-Hermes-13b
Motivation
According to https://lmsys.org/blog/2023-06-22-leaderboard/ , Nous-Hermes-13B isn't even in the top 10.
@ypeleg can you please clarify:
some people on reddit are already starting to say that on certain prompts it is "at the level of GPT-4"
Are you referring to a fine-tuned version Nous-Hermes model?
According to https://lmsys.org/blog/2023-06-22-leaderboard/ , Nous-Hermes-13B isn't even in the top 10.
@ypeleg can you please clarify:
some people on reddit are already starting to say that on certain prompts it is "at the level of GPT-4"
Are you referring to a fine-tuned version Nous-Hermes model?
Should I go ahead with setting up the HF Space for the model despite this being the case?
https://huggingface.co/NousResearch/Yarn-Mistral-7b-128k
Nous-Yarn-Mistral-7b-128k is a state-of-the-art language model for long context, further pretrained on long context data for 1500 steps using the YaRN extension method. It is an extension of Mistral-7B-v0.1 and supports a 128k token context window.