YangShuaiTHU

Can't load woq int4 model

4

I'm trying to evaluate the int4 quantized model with the tools using ```python from intel_extension_for_transformers.llm.evaluation.lm_eval import evaluate ``` like what's done in `/examples/huggingface/pytorch/text_generation`. I succeeded when I quantized my local...