LocalAI
LocalAI copied to clipboard
Replace model in Build tutorial for mac to phi-2
Is your feature request related to a problem? Please describe.
Just a suggestion to replace the model in this tutorial from gpt4all-j
to phi-2
. A smaller model might help new users to follow the tutorial. Can serve as a good first issue for beginner contributors.
Describe the solution you'd like
Replace the model link with https://huggingface.co/TheBloke/phi-2-GGUF/resolve/main/phi-2.Q2_K.gguf and also change the model name in the request to phi-2.Q2_K
.
Additional context I tried running phi-2 on my M2 MBA using the above replacements. Everything works like a charm :)
Good point! Do you feel to take a stab at it?
Hello there! Just diving into the LocalAI community. I'm excited about picking up this issue as my starting point, if you guys are okay with it.