LocalAI icon indicating copy to clipboard operation
LocalAI copied to clipboard

Replace model in Build tutorial for mac to phi-2

Open ManishAradwad opened this issue 1 year ago • 1 comments

Is your feature request related to a problem? Please describe.

Just a suggestion to replace the model in this tutorial from gpt4all-j to phi-2. A smaller model might help new users to follow the tutorial. Can serve as a good first issue for beginner contributors.

Describe the solution you'd like Replace the model link with https://huggingface.co/TheBloke/phi-2-GGUF/resolve/main/phi-2.Q2_K.gguf and also change the model name in the request to phi-2.Q2_K.

Additional context I tried running phi-2 on my M2 MBA using the above replacements. Everything works like a charm :)

ManishAradwad avatar Feb 18 '24 17:02 ManishAradwad

Good point! Do you feel to take a stab at it?

mudler avatar Feb 23 '24 17:02 mudler

Hello there! Just diving into the LocalAI community. I'm excited about picking up this issue as my starting point, if you guys are okay with it.

LeonSijiaLu avatar Apr 28 '24 01:04 LeonSijiaLu