langchain icon indicating copy to clipboard operation
langchain copied to clipboard

Published 20 hours ago • verified publisher icon langchain-ai

llamacpp wrong default value passed for `f16_kv`

Open zatevakhin opened this issue 1 year ago • 0 comments

Fixes default f16_kv value in llamacpp; corrects incorrect parameter passed.

See: https://github.com/abetlen/llama-cpp-python/blob/ba3959eafd38080f3bf3028746406f350a8ef793/llama_cpp/llama.py#L33

Fixes #3241 Fixes #3301

zatevakhin avatar Apr 21 '23 21:04 zatevakhin