bug: when use Jan with mistral server REST API and open ai client Jan does not return JSON

[topce]

Describe the bug bug: when use Jan with mistral server REST API and open ai client Jan does not return JSON

Steps to reproduce Steps to reproduce the behavior:

1. Run Jan server with mistral model
2. run open ai client typescript "openai": "4.29.0",
3. open ai client expect to get JSON Jan return String Expected behavior Jan should return JSON not text if I parse text to JSON it works but it should return JSON so I do not need to parse anything ;-)

Screenshots If applicable, add screenshots to help explain your issue.

Environment details

• Operating System: [ Windows 10]
• Jan Version: all versions including latest
• Processor: [Intel
• RAM: 32 GB
• Any additional relevant hardware specifics: [e.g., Graphics card, SSD/HDD]

[mufeedvh]

You don't need CUDA to run this, the models used do not require compute, you can install the dependencies into your venv and run this entirely on the CPU.