FreedomGPT icon indicating copy to clipboard operation
FreedomGPT copied to clipboard
verified publisher icon ohmplatform

Larger LLM for people with a lot of RAM?

Open kaxonomy opened this issue 2 years ago • 2 comments

Is there any way we can download a larger LLM if we have enough RAM and resources to support it? I currently have 128GB for reference.

kaxonomy avatar Apr 14 '23 05:04 kaxonomy

Yes, please feel free to submit a PR. It would be relatively easy to give people an option to use the larger LLM if they have a more powerful machine.

ohmguru avatar Apr 14 '23 15:04 ohmguru

I support this issue! I need to be able to use Alpaca 30B and Alpaca Native 13B on my computer!!

ItsPi3141 avatar Apr 22 '23 16:04 ItsPi3141