Pi
Pi
> Deathly slow under Linux, shows low cpu but all memory in use, though the system monitor only shows 72% of 32gb in use. If it's really slow, it's possible...
Yes I'll add a settings page for that soon.
Performance will be worse if you use all 16 cores. Your OS will start to kinda die and it will make everything lag.
> I am using 5900x, there is 8 more thread available, is it possible to allow more core? I want to use 22 out of the 24 threads available. Or...
> @ItsPi3141 - I've got a server with 60 cores and it shows as using 32/60 threads. Based on that performance test you listed, is 16 better than 32? My...
> Thank you @bakman2, this worked, but should off-course not be needed. It is needed. There's no way around it. I don't have an app signing certificate (I don't want...
>  > it's anyway doesn't work :) Your RAM is full so it's using swap, which is very slow. If you're using a large mode (e.g. 30B or 65B),...
> > > > I would recommend you add it to the instruction in the installer. > > > I might add it to the FAQ instead of the MacOS...
>  >  > Same problem What model are you using?
> > What model are you using? > https://huggingface.co/Pi3141/alpaca-7b-native-enhanced/tree/main > [ggml-model-q4_1.bin](https://huggingface.co/Pi3141/alpaca-7b-native-enhanced/blob/main/ggml-model-q4_1.bin) How long did you wait for? I don't know the specs of ARM64 Macs, but it's possible that it's...