Jonah Lynch

> 8, which would be nice to use. With the current setup I'm only using 4

> I guess this is because hyperthreading does not help with running the model? So the number of virtual cores is not important only number of physical cores? That looks...

> This project is CPU only however there's a different one that runs on the GPU. Keep in mind the weights are not compatible between the two projects. > >...

Hi Iraklis, How much memory do you have? Have you tried one of the smaller quantized versions that has been recently released? Also, what exact shell command are you using...

It looks to me like a corrupt binary. Maybe try re-downloading the model and start from scratch? Sorry I can’t be more helpful > On Jun 7, 2023, at 10:20...