Rahul

Quantized model loading method expects the model should be locally available.

2

I use ipex-llm to quantize and push models to hub. But it seems `load_low_bit` expects the model to be locally available and cant take it from huggingface hub. It would...