RiccaDS

I confirm @AceFromSpace version works a charm for now. I am actually using zipline-reloaded. Thx

Yes you are right, it works on a per-line basis. I was working on multiline strings however (omitted this sorry). I am having a hard time ereasing multiline strings and...

hi, I have the same inlining problem when using -mavx , running Linux Mint on i7-2630QM, 16GB RAM, pretty old laptop (13 years), and the problem is I'm not able...

I seem to have resolved the same issue on my system. Now I get a make error but this is another story. In my case I was installing in a...

> Same problem here! Can someone answer if there is a way to install the model in another directory? Not on C Check my reply above to install in another...

> > That's still extremely slow for 24 threads CPU .... Such amount of text with 7b model should be produced within 20 second ..my CPU is 16 threads.maybe this...

Thank you very much for the reply. Indeed my laptop has quite a few years, around 14, still doing great however. I'm running a quad core intel core i7-2630QM. I...

@Monotoba thanks yes I actually completely removed the relevant code in the makefile as no flags seemed to be supported. So I launched make in the folder and the attached...

Sure, I checked what you asked me, all the flags are ok except the -mavx; it breaks the make process. Thanks for helping

Clearly I have to download the model, this wasn't clear to me. Tough I am having a hard time finding a reliable download link for ggml-alpaca-7b-q4.bin. EDIT: downloaded but I...