LLMFarm
LLMFarm copied to clipboard
Unable to save a temp = 0
Enter in the sampling panel Choose "temperature" as sampling method, and set temp to 0 Save Come back to the sampling panel : the sampling method is set to "greedy"
Other values (0,01 for example) are working.
Hi sampling in llama.cpp has recently undergone many changes, new samplers added, new API, etc. I can hardly keep up with this trend. Previously llama.cpp itself decided that greedy sampling mode is enabled if temp=0. I don't know how it is now. I'll try to figure it out later.