Cody Snider
Cody Snider
The existing redis plugin is no longer maintained and has some issues. The import issue with caddy has been addressed on this fork and it compiles correctly with latest CoreDNS.
Tested with: ```python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="TheBloke/OpenHermes-2.5-Mistral-7B-GGUF", filename="openhermes-2.5-mistral-7b.Q4_K_M.gguf", n_ctx=4096, n_gpu_layers=10, verbose=True ) llamalm = dspy.LlamaCpp(model="llama", llama_model=llm) dspy.settings.configure(lm=llamalm) def summarize_document(document): summarize = dspy.ChainOfThought('document -> summary') response =...
What interest is there in an all-in-one docker setup (including reverse proxy and let's encrypt companion container)? I'm building one out for my own use and, if there is interest...