ukiyocode

list of tokens and output: main: prompt: ' list all US states in alphabetical order:' main: number of tokens in prompt = 10 1 -> '' 1051 -> ' list'...

Wow you're right. In my case it answers correctly with 4 threads but not with 8 or 10. Same prompt, same seed the only difference is the number of threads.

After more testing I think we can close this one. The new version either matches or outperforms the old one in most tasks. The number of threads affecting output is...

had same errors for starcoder, you need to make 4 changes in examples\starcoder\main.cpp to compile: 15: #include (instead of #include ) 204: struct ggml_init_params params = { ctx_size, NULL, false...

scratch that i'm not getting any output from it so that 724 line is probably wrong

@eublefar Thx, it works now. Someone already added your line to the repo, so all you have to do now is the 4 changes i mentioned b4.

well mostly fine it seems to add [0m22m or [0m24m in front of left bracket (, but other than that formatting and colors are preserved

That MANROFFOPT='-c' thing doesn't work for me, but eth-p's suggestion works perfectly, thanks :)