Antonin Leroy

Must have feature. Will enable using mixtral decently on a single GPU 💯

@joein Thanks for your answer. Yes it was the issue because I had to upgrade vllm version. I had to create a new database and re-vectorise my documents. I agree...

@joein Thanks will try to do that.