serge icon indicating copy to clipboard operation
serge copied to clipboard

Cannot use the alpaca.7B model

Open VanHallein opened this issue 1 year ago • 2 comments

Bug description

I downloaded the ggml-alpaca-7b-q4.bin from the internet and docker cp it in to the /usr/src/app/weights folder. It is there now, however it stays unnoticed by Serge. Even after restarting and fumbling around, I cannot select the model when starting a chat.

Steps to reproduce

Download ggml-alpaca-7b-q4.bin docker cp ./ggml-alpaca-7b-q4.bin <DOCKER CONTAINER>:/usr/src/app/weights restarting the docker container

Environment Information

Debian 10.03 runnig in VirtualBox Docker version 23.0.2, build 569dd73

Screenshots

No response

Relevant log output

No response

Confirmations

  • [X] I'm running the latest version of the main branch.
  • [X] I checked existing issues to see if this has already been described.

VanHallein avatar Mar 30 '23 22:03 VanHallein

Have you tried downloading 7B from the download manager included in Serge ? Otherwise, you could try to rename your file from ggml-alpaca-7b-q4.bin to 7B.bin to see if Serge can detect it.

FenarkSEC avatar Mar 31 '23 15:03 FenarkSEC

@VanHallein Did you figured out the issue?

gaby avatar Apr 17 '23 00:04 gaby