hiro

**Describe the bug** - I see many bugs/ not working APIs on `localhost:1337` swagger **Steps to reproduce** Steps to reproduce the behavior: 0. Install nightly build: https://discord.com/channels/1107178041848909847/1191638499355537418/1194735991794176031 1. Go to...

## Describe Your Changes - Recursive scanning folder (2 levels) for files with `.gguf/.ggml` as extension to get metadata. - If those are valid `ggml/gguf`, automatically create `models/model.json` and duplicate...

chore: Bump version nitro to 0.2.10

1

## Describe Your Changes - Bump version for nitro to 0.2.10: https://github.com/janhq/nitro/releases/tag/v0.2.10 ## Fixes Issues ## Self Checklist - [x] Added relevant comments, esp in complex areas - [x] Updated...

- [ ] Step by Step documentation for Jan Triton inference server with TensorRT-LLM - 1 day - [ ] Updated code in `triton-tensorrt-llm` extension to support - 1 day

## Motivation - A few reports of Jan v0.4.4 taking up compute and or ram. - Related to https://github.com/janhq/jan/issues/1650 - Conversation: https://discord.com/channels/1107178041848909847/1197752008568995941 - Related reddit: https://www.reddit.com/r/opensource/comments/198jamd/comment/kisug4x/?context=3&share_id=LhHNxdiS_h7t4OUSgpZ56&utm_content=1&utm_medium=ios_app&utm_name=ioscss&utm_source=share&utm_term=1 ## Expected behavior A...

## Describe Your Changes - Add all updated OpenAI models (supported from OpenAI platform) - Blocked by the UI to show `remote` versus `local` models to be implemented (Hub) -...

feat: Convert long string (more than 4096 tokens) to attached file and use RAG

1

**Problem** Context: https://discord.com/channels/1107178041848909847/1187241936302649435/1204776884001439825 Not intended to derail the conversation, but one thing I would be curious about (if it was not raised anywhere). I have been using claude for a...

feat: Suggest follow up questions based on uploaded documents

1

**Problem** - Similar feature in ChatPDF, after document ingested/ a query got answered, 3 suggested document will show up **Success Criteria** - After document ingested, call a request to LLM...

**Describe the bug** In case user turn on `Retrieval` - User might choose their remote OpenAI LLM models, they might need to add embedding API endpoint as well, it will...

## Describe Your Changes - [x] Add vulkan nitro to support AMD GPU and Intel Arc version - [x] Verify Jan with nitro vulkan can run on AMD GPU -...