intel-extension-for-transformers
intel-extension-for-transformers copied to clipboard
ImportError: cannot import name 'WeightOnlyQuantizedLinear' from 'intel_extension_for_pytorch.nn.utils._quantize_convert'
trafficstars
I try to run the TTS (English and Multi Language Text-to-Speech) in my PC.
https://github.com/intel/intel-extension-for-transformers/blob/main/intel_extension_for_transformers/neural_chat/pipeline/plugins/audio/README.md
It occured the cannot import name 'WeightOnlyQuantizedLinear' error info as below.
~/WorkSpace/TTS$ python eng-tts.py
Traceback (most recent call last):
File "/home/anna/WorkSpace/TTS/eng-tts.py", line 1, in <module>
from intel_extension_for_transformers.neural_chat.pipeline.plugins.audio.tts import TextToSpeech
File "/home/anna/.local/lib/python3.10/site-packages/intel_extension_for_transformers/neural_chat/__init__.py", line 26, in <module>
from .chatbot import build_chatbot
File "/home/anna/.local/lib/python3.10/site-packages/intel_extension_for_transformers/neural_chat/chatbot.py", line 19, in <module>
from intel_extension_for_transformers.transformers.llm.quantization.optimization import Optimization
File "/home/anna/.local/lib/python3.10/site-packages/intel_extension_for_transformers/transformers/__init__.py", line 59, in <module>
from .modeling import (
File "/home/anna/.local/lib/python3.10/site-packages/intel_extension_for_transformers/transformers/modeling/__init__.py", line 21, in <module>
from .modeling_auto import (AutoModel, AutoModelForCausalLM,
File "/home/anna/.local/lib/python3.10/site-packages/intel_extension_for_transformers/transformers/modeling/modeling_auto.py", line 94, in <module>
from intel_extension_for_pytorch.nn.utils._quantize_convert import (
ImportError: cannot import name 'WeightOnlyQuantizedLinear' from 'intel_extension_for_pytorch.nn.utils._quantize_convert' (/opt/python-3.10.13/lib/python3.10/site-packages/intel_extension_for_pytorch/nn/utils/_quantize_convert.py)