llm_client

llm_client copied to clipboard

Hey Shelby, thanks for wrapping this all in a package! I'm often working with multiple choice questions. From previous experiments with a variety of LLMs I noticed that it's much...

rickbeeloo

I was a bit confused by: https://github.com/ShelbyJenkins/llm_client/blob/ed1c68a501a561548530dabd6019c2c561619328/src/llm_backends/llama_cpp/mod.rs#L27 As that path does not exist in the repo, so maybe adding ` git clone https://github.com/ggerganov/llama.cpp` in the README clarifies that. (Unrelated, cool...

rickbeeloo

justin-luoma