ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Benchmarking Chatglm3-6B on Xeon SPR: Forward() expected at most 5 arguments but received 6

Open hangfu-guo opened this issue 1 year ago • 1 comments

Issue happens during benchingmarking ChatGLm3-6B, using run-spr.sh and config test_api as bigdl_ipex_int4.

Environment:]

pip install --pre --upgrade ipex-llm[all] && \

# Fix CVE-2024-22195

pip install Jinja2==3.1.3 && \

pip install torch==2.2.0 torchvision==0.17.0 torchaudio==2.2.0 --index-url https://download.pytorch.org/whl/cpu && \

pip install intel-extension-for-pytorch==2.2.0 && \

pip install oneccl_bind_pt==2.2.0 --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/cpu/us/ && \

pip install transformers==4.36.2

Error: image

hangfu-guo avatar Apr 07 '24 06:04 hangfu-guo

This issue will be fixed by pr-10678

hzjane avatar Apr 07 '24 07:04 hzjane