jan
jan copied to clipboard
bug: Base URL must be different to read models or do Inference (Mistral)
Version: 0.7.2
Describe the Bug
If I set the Base URLfor the Mistral Model Provider to https://api.mistral.ai/ I can do inference as usual. But if I want to add a model, click the "+" and click the refresh button, no model is shown:
If I set the Base URL to https://api.mistral.ai/v1 I can successfully refresh and add models:
But chatting doesn't work any more:
Steps to Reproduce
See above
Screenshots / Logs
See above. Log don't show anything useful.
Operating System
- [ ] MacOS
- [X] Windows
- [ ] Linux