Alpaca icon indicating copy to clipboard operation
Alpaca copied to clipboard

Manage models: define custom paths & show defaults

Open tsilvs opened this issue 1 year ago • 4 comments

Is your feature request related to a problem? Please describe.

I already have a lot of GiBs of LLMs downloaded on my PC. My connection is metered & slow, storage is limited as well.

I can't afford downloading hundreds of GiBs of data again. It will be slow, expensive & polluting.

Describe the solution you'd like

  • Disclose downloads location in UI
  • Let users specify new default model download directory

Describe alternatives you've considered

  • Support backups & restores of models

Additional context

Alpaca 0.9.2 flatpak from flathub

tsilvs avatar May 31 '24 13:05 tsilvs

Possibly related to #76

tsilvs avatar May 31 '24 13:05 tsilvs

Hi, I don't think I'll be making the download directory modifiable, I prefer it to stay inside the Flatpak directory. For now what you can do if you want to migrate an existing ollama instance to alpaca is this

Jeffser avatar May 31 '24 15:05 Jeffser

what you can do if you want to migrate an existing ollama instance to alpaca is this

Could be better for UX to add a note somewhere in preferences or list of models about current location for models being ~/.var/app/com.jeffser.Alpaca/data/.ollama

tsilvs avatar Jun 01 '24 09:06 tsilvs

@Jeffser another solution idea: what if you add a method of symlinking or hardlinking of models from any user defined directory to ~/.var/app/com.jeffser.Alpaca/data/.ollama?

tsilvs avatar Jun 02 '24 13:06 tsilvs

Sooo I have some news for 3.0.0

image

Jeffser avatar Dec 19 '24 02:12 Jeffser

https://github.com/Jeffser/Alpaca/commit/e450547bea2b184ba44a25f4a7354b02689bdb7f

Jeffser avatar Dec 19 '24 02:12 Jeffser