zeko
Results
2
comments of
zeko
Need this
I got very similar results with mistral-7b-instruct-v0.2.Q5_K_M.gguf. As an alternative solution, you can get correct, deterministic output by setting top_k=1 instead of using temperature.