jan
jan copied to clipboard
janhq
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
**Problem** Sometimes, people like me run an openai compatible server instead of running the model through Jan's nitro for better tailored to hardware compatibility and availability. The openai inference partially...
**Describe the bug** I've started a jan by docker running on-prem on a remote server, but when I connect to the IP, it shows that something went wrong, such as...
## Describe Your Changes - Simply customize the scroll-bar style, to get a more modern and unified style. ## Fixes Issues - Closes no issues ## Self Checklist - [...
## Describe Your Changes - Remove hidden overflow property to allow scrolling - Update layout -> submit and cancel buttons are now below the textarea instead of being next to...
**Describe the bug** Hi! Llama3-gradient is out, and it has support for a larger context window. 256k is [suggested by Ollama](https://ollama.com/library/llama3-gradient). However, in the Jan UI, the maximum context length...
**Problem** Actually not sure if this is a bug or feature request. While text is generating/streaming, the window is constantly scrolling down. Usually this is good. Sometimes I would like...
**Describe the bug** Jan's API interface `writeFileSync` and `appendFileSync` does not filter parameters, resulting in an arbitrary file upload vulnerability. Jan's API interface readFileSync does not filter parameters, resulting in...
**Describe the bug** Jan has issues with properly displaying mathematical content. When inline mathematical statements (enclosed within single `$` delimiters) are used, the output duplicates the expression alongside the rendered...
**Pages** - https://jan.ai/docs/built-in/llama-cpp **Success Criteria** 1. My install of jan.ai doesn't have a `~/jan/engines/nitro.json` at all. It only has `groq.json` and `openai.json`. 2. I have run multiple local GGUF models...
**Problem** TensorRT-LLM is one of the biggest features in jan. As the docker environments usually include all kind of stuff to run the software with it's full set of features,...
