gpt4all icon indicating copy to clipboard operation
gpt4all copied to clipboard

Support falcon models

Open bitsnaps opened this issue 2 years ago • 2 comments

Feature request

I'm not sure if it's already there, but since GPT4ll is mentioned at Falcon-7B-Instruct I think it's not gonna be hard to be implemented, right?

Motivation

A better performance, accuracy since falcon is outperforming most other models on NLP benchmarks.

Your contribution

I'm not sure if I can, neither if I have permissions!

bitsnaps avatar May 31 '23 09:05 bitsnaps

I may be wrong, but it's probably related to if/when the model will be supported in [llama.cpp](https://github.com/ggerganov/llama.cpp/issues/1602

Update: Was indeed wrong :)

mvenditto avatar May 31 '23 19:05 mvenditto

We don't need llama.cpp to support falcon for us to support it. Notice we support MPT and GPTJ :) It's being worked on.

AndriyMulyar avatar Jun 01 '23 00:06 AndriyMulyar