Pierrick Hymbert
Pierrick Hymbert
Good point. Meanwhile, you can use kv overrides.
> Do you know if there is a way to manually specify the chat format in server mode? No but you can use the the `infill` endpoint as shown above...
I just worry the README.md on the welcome page will become difficult to read if we add so much detailled instruction
> What I'm wondering is if the middleware should report error 500 also for the static pages If we can return the static pages while the model is loading, this...
Sure, good luck, please ping here for any question
Hi @TevinWang, are you still working on this issue ?
Thanks, no worries, take your time.
Did someone download the torrent ? Is it an HF model with modeling code or only weights inside without the architecture ?
> Don't know if usefull but it's already up on huggingface. https://huggingface.co/mistral-community/Mixtral-8x22B-v0.1 It is useful, thanks, I did not notice they changed the org. Let's go then
It looks so, just bigger: https://huggingface.co/mistral-community/Mixtral-8x22B-v0.1/blob/main/config.json https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1/blob/main/config.json