ipex-llm
ipex-llm copied to clipboard
Benchmarking Chatglm3-6B on Xeon SPR: Forward() expected at most 5 arguments but received 6
Issue happens during benchingmarking ChatGLm3-6B, using run-spr.sh and config test_api as bigdl_ipex_int4.
Environment:]
pip install --pre --upgrade ipex-llm[all] && \
# Fix CVE-2024-22195
pip install Jinja2==3.1.3 && \
pip install torch==2.2.0 torchvision==0.17.0 torchaudio==2.2.0 --index-url https://download.pytorch.org/whl/cpu && \
pip install intel-extension-for-pytorch==2.2.0 && \
pip install oneccl_bind_pt==2.2.0 --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/cpu/us/ && \
pip install transformers==4.36.2
Error:
This issue will be fixed by pr-10678