OpenAdapt icon indicating copy to clipboard operation
OpenAdapt copied to clipboard

Implement Nous-Hermes-13b

Open abrichr opened this issue 1 year ago • 3 comments

Feature request

We want to get completions using https://huggingface.co/NousResearch/Nous-Hermes-13b

Motivation

image https://twitter.com/Yampeleg/status/1668337702440165376

abrichr avatar Jul 18 '23 01:07 abrichr

According to https://lmsys.org/blog/2023-06-22-leaderboard/ , Nous-Hermes-13B isn't even in the top 10.

@ypeleg can you please clarify:

some people on reddit are already starting to say that on certain prompts it is "at the level of GPT-4"

Are you referring to a fine-tuned version Nous-Hermes model?

abrichr avatar Jul 18 '23 22:07 abrichr

According to https://lmsys.org/blog/2023-06-22-leaderboard/ , Nous-Hermes-13B isn't even in the top 10.

@ypeleg can you please clarify:

some people on reddit are already starting to say that on certain prompts it is "at the level of GPT-4"

Are you referring to a fine-tuned version Nous-Hermes model?

Should I go ahead with setting up the HF Space for the model despite this being the case?

FFFiend avatar Jul 21 '23 16:07 FFFiend

https://huggingface.co/NousResearch/Yarn-Mistral-7b-128k

Nous-Yarn-Mistral-7b-128k is a state-of-the-art language model for long context, further pretrained on long context data for 1500 steps using the YaRN extension method. It is an extension of Mistral-7B-v0.1 and supports a 128k token context window.

abrichr avatar Nov 11 '23 20:11 abrichr