ipex-llm
ipex-llm copied to clipboard
Unable to save quantized model
I m trying to save a int4 quantized model. When i try to save it , i get this error when trying to solve the issue.
Traceback (most recent call last):
File "C:\Users\AI-Perf\Varsha\ipex-llm\python\llm\example\GPU\HF-Transformers-AutoModels\Save-Load\generate.py", line 58, in
Attached is my code.