llama-gpt icon indicating copy to clipboard operation
llama-gpt copied to clipboard

Published 20 hours ago • verified publisher icon getumbrel

No way to get 70b model from Umbrel app store?

Open ThomasBurgess2000 opened this issue 1 year ago • 2 comments

I've got a machine with 80GB of RAM that I'd like to try the 70B param model on, using the UmbrelOS app if possible. But I don't see a way to get that model.

ThomasBurgess2000 avatar Aug 23 '23 00:08 ThomasBurgess2000

Echo that. Hopefully the next release on Umbrel store will provide that feature. Thanks!

MyAnonymousGitHubProfile avatar Aug 25 '23 14:08 MyAnonymousGitHubProfile

Thanks, guys! Noted for a future release. We'll make it easy to change the model within the app, with recommendations based on the underlying CPU, GPU and RAM size.

mayankchhabra avatar Aug 26 '23 06:08 mayankchhabra