Vincent Bosch
Vincent Bosch
**Describe the bug** When trying to download any given model on the models page from Jan, the download starts but hangs at 0% and after a certain period of time...
Hi! While researching the Audi E-tron, I discovered that Audi reused the 95kWh battery from the E-tron 55 in the facelift Q8 E-tron 50. They also upped the usable kWh...
**Describe the bug** Jan cannot load Qwen 1.5, more specifically 72b chat Q6. Going through the logs it appears to load correctly, then multiple Nitro errors are shown and the...
**Describe the bug** When starting a new thread and interacting with the model, I can see after the first prompt the thread-title changed. However, after closing and reopening Jan, the...
### What happened? When starting a conversation with a model served via Ollama, it sometimes happens the prompt stops prematurely with an ETIMEDOUT error. After resending the prompt, it is...
## Describe the bug Log output for building with --features metal: `error[E0425]: cannot find value `devices` in this scope --> mistralrs-core/src/pipeline/isq.rs:194:26 | 194 | .zip(devices) | ^^^^^^^ help: a local...
**Describe the bug** On newer Apple Silicon Macs, the fans can be turned off by the system and cannot manually be turned on. Only after the system decides the fans...
With larger models, like Mistral-Large, I encounter that the UI-endpoint I am using (for example Typing Mind) loses connection with the endpoint, but generation continues in the background and doesn't...
At the moment, exo only supports loading models that are in the huggingface cache-folder. In case you have your own quants of a given model, you'd need to create a...
## 🐛 Bug I tried to use Mistral Small 7B Instruct v0.3 as draft model for Mistral Large 2407. When not served using "--mode server", the model(s) never respond. I...