Antonin Leroy

Must have feature. Will enable using mixtral decently on a single GPU 💯

@joein Thanks for your answer. Yes it was the issue because I had to upgrade vllm version. I had to create a new database and re-vectorise my documents. I agree...

@joein Thanks will try to do that.

It's trying to download the model from hf yes it's the default behaviour or the unstructured library.

Hey I haven't made any progress on this unfortunatelly I'm lost in the module code... There's probably a modification to do in the [get_model()](https://github.com/Unstructured-IO/unstructured-inference/blob/76619ca66f47d013f6656fce775f6fddde5d36ae/unstructured_inference/models/base.py#L52) function on the unstructured-inference dependency. The...