ollama icon indicating copy to clipboard operation
ollama copied to clipboard

Add support for llamacpp min_p sampler

Open JoseConseco opened this issue 2 years ago • 3 comments

https://github.com/ggerganov/llama.cpp/pull/3841 obraz

It supposed to give better results compared to top_k, top_p. I tried to add this min_p - parameter to llama options, but it was unrecognized.

JoseConseco avatar Nov 15 '23 19:11 JoseConseco

I would love to see this in Ollama.

fast-90 avatar Jan 06 '24 10:01 fast-90

PR: https://github.com/jmorganca/ollama/pull/1825

Robitx avatar Jan 06 '24 15:01 Robitx

I think the PR needs to be rebased again because it says "can't be automatically merged." Unless it's waiting on something else in the workflow?

FellowTraveler avatar May 22 '24 10:05 FellowTraveler