jan
jan copied to clipboard
janhq
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
hi, I ran Jan via docker compose, but all models cannot start "Not enough RAM", but I have 512GB of memory in the server.  
**Describe the bug** I have tried stable and nighly version - with clean install and JAN fails to load models (standard settings) or fails to run inference on Vulcan (you...
**Problem** The downloaded file cannot be verified for validity. **Success Criteria** A SIG or SHA or both will be great **Additional context** None
**Problem** Jan is only support 1 gguf model file at a time **Success Criteria** We can help users to merge gguf files into 1 and load the model for them...
getting error: docker-compose.yml: yaml: line 208: mapping values are not allowed in this context when running docker compose --profile cpu-fs up -d with both docker-compose.yml and docker-compose-dev.yml Ubuntu (kubuntu) 24.04...
## Describe Your Changes - Fixed an issue where cortex cpp is not terminated properly ## Fixes Issues - Closes # - Closes # ## Self Checklist - [ ]...
**Describe the bug** - Model cannot start on Mac M3 `llama3-8b-instruct` **Steps to reproduce** Steps to reproduce the behavior: 1. Download model 2. Click `Use` 3. Chat 4. It shows...
**Motivation** @janhq/monitoring-extension:build: RequestError: tunneling socket could not be established, cause=getaddrinfo ENOTFOUND 10809 @janhq/monitoring-extension:build: at ClientRequest. (D:\nobushu\jan\extensions\monitoring-extension\node_modules\got\index.js:111:21) @janhq/monitoring-extension:build: at Object.onceWrapper (node:events:633:26) @janhq/monitoring-extension:build: at ClientRequest.emit (node:events:518:28) @janhq/monitoring-extension:build: at ClientRequest.onError (D:\nobushu\jan\extensions\monitoring-extension\node_modules\tunnel-agent\index.js:179:21) @janhq/monitoring-extension:build: at...
## Motivation Seems all the other LLMs do this now, so would be very useful comfort to have in Jan!
## Describe Your Changes - update 8b and 35b ## Fixes Issues - Closes # - Closes # ## Self Checklist - [ ] Added relevant comments, esp in complex...