404 error when loading `Phi3-small-8k-instruct`

[rlouf]

My installation is based on c2ff402

./mistralrs-server -i plain -m microsoft/Phi-3-small-8k-instruct -a phi3

I run into the following error:

Could not get file "tokenizer.json" from API: RequestError(Status(404, Response[status: 404, status_text: Not Found, url: https://huggingface.co/microsoft/Phi-3-small-8k-instruct/resolve/main/tokenizer.json]))

The small and medium version load correctly. I looked at the files on the Hugging Face hub, and indeed there is no tokenizer.json file. The tokenizer_config.json file however is fairly dissimilar to the config for models where tokenizer.json is present. I think it instructs AutoTokenizer to return the Phi3SmallTokenizer class in this file. This is rather unusual, and looks like a workaround would be painful.