cortex
cortex copied to clipboard
janhq
Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan
Due to our inherently lack of understanding on how C++ build system work on windows the CI on windows right now is quite slow and not optimal, would be great...
should have unit tests
## Objective - I would like to float a thought balloon for Nitro to expand its feature set, and automagically handle model loading/unloading ops and abstract it from the Dev...
**Problem** A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] **Success Criteria** A clear and concise description of what you want to happen....
## Objective - Do we need a simple queue system? ### Motivation _Nullpointer Errors?_ - Currently, inference requests are handled FIFO - We are adopting an OpenAI API, which means...
**Problem** A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] **Success Criteria** A clear and concise description of what you want to happen....
**Problem** Users need a way to manage content policies **Success Criteria** A clear and concise description of what you want to happen. **Sub Issues** - **Additional context** https://platform.openai.com/docs/api-reference/moderations/create
**Problem** A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] **Success Criteria** A clear and concise description of what you want to happen....
**Problem** A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] **Success Criteria** A clear and concise description of what you want to happen....
**Problem** A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] **Success Criteria** A clear and concise description of what you want to happen....