Badis
Badis
@nusu-github thank you so much it worked on my side! Everyone, here's the steps to build your .exe with clang (better than MSVC [at the moment](https://github.com/ggerganov/llama.cpp/pull/375)) 1. Install Clang To...
> There are always going to be small differences in the generation between different implementations, in this case it is probably because the lack of FMA on MSVC means that...
@slaren I agree with you, if the perplexity is similar between GCC and Clang I don't see the problem either. I guess I have to test it out to be...
@PriNova -s 0 was in the range of non-random interval last week, I guess they changed it now 😅
@x02Sylvie we should test the speed and the perplexity of both of those compilers and see if one is better than the other. If Clang has significantly better results than...
Welp, guess I'll stick to Stable diffusion then, at least this one doesn't treat me like a child who doesn't know what's "good" or "bad".
Loooool https://www.reddit.com/r/StableDiffusion/comments/132fnhq/after_backlash_on_reddit_and_github_stability/
@mathieu-heyarctic https://github.com/SJTU-IPADS/PowerInfer/issues/13 is for Mistral, not Mixtral
Haven't they fixed this with that? https://github.com/oobabooga/text-generation-webui/pull/820
> When loading a model, it tells you the quantization version. Oh yeah I have the Version 2  But still, even with those "slow" models I have I can...