mohbay

gated models do not work

1

Hi, This is a very useful application, but it does not work with gated models, I tried using huggingface-cli login and also logging in from python, but still gated models...

non-persistent simple example does not work

5

Starting from the code pipe = mii.pipeline("mistralai/Mistral-7B-v0.1") It does not work (on A100 python 3.10 and cuda12.1 ImportError: torch_extensions/py310_cu121/ragged_device_ops/ragged_device_ops.so: cannot open shared object file: No such file or directory