FreedomGPT icon indicating copy to clipboard operation
FreedomGPT copied to clipboard

Can I use a larger model? Can I use display-based reasoning?

Open huxixx opened this issue 2 years ago • 3 comments

Can I use a larger model? Can I use display-based reasoning? May be I can have these options.

huxixx avatar Apr 10 '23 17:04 huxixx

Not with this code. This is just a fancy frontend for alpaca.cpp which only supports Alpaca-7b.

You should use llama.cpp

https://github.com/ggerganov/llama.cpp

With that, you can run both the Alpaca 13b and the Llama 13b model, q4. You could also run even larger models.

cooperdk avatar Apr 13 '23 00:04 cooperdk

@Nguyenpham89 - try again

cooperdk avatar Apr 13 '23 04:04 cooperdk