LLMFarm icon indicating copy to clipboard operation
LLMFarm copied to clipboard

Unable to save a temp = 0

Open ccoq opened this issue 1 year ago • 1 comments

Enter in the sampling panel Choose "temperature" as sampling method, and set temp to 0 Save Come back to the sampling panel : the sampling method is set to "greedy"

Other values (0,01 for example) are working.

ccoq avatar Dec 09 '24 20:12 ccoq

Hi sampling in llama.cpp has recently undergone many changes, new samplers added, new API, etc. I can hardly keep up with this trend. Previously llama.cpp itself decided that greedy sampling mode is enabled if temp=0. I don't know how it is now. I'll try to figure it out later.

guinmoon avatar Dec 17 '24 11:12 guinmoon