Lei Sun

MTL Linux Qwen-VL: LLVM ERROR: GenXCisaBuilder failed

1

Follow the guide to set up qwen-VL ipex-llm version:2.1.0b20240515, python version 3.9 https://github.com/intel-analytics/ipex-llm/blob/main/python/llm/example/GPU/PyTorch-Models/Model/qwen-vl/chat.py download model from https://hf-mirror.com/Qwen/Qwen-VL-Chat-Int4/tree/main (nb_dev) intel@intel-Meteor-Lake-Client-Platform:~/lei/ipex-llm/python/llm/example/GPU/PyTorch-Models/Model/qwen-vl$ python chat.py 2024-05-16 00:15:59,668 - INFO - Note: NumExpr detected 22...

When convert MiniCPM-V model from ModelScope to low-bit, got error: AttributeError: 'NoneType' object has no attribute 'add_bos_token'

12

1. Download MiniCPM-V model from ModelScope 2. Convert the mode to low-bit by the command in GPU/ModelScope-Models/Save-Load as follows. python ./generate.py --repo-id-or-model-path ./models/OpenBMB/MiniCPM-V --save-path ./models/OpenBMB/MiniCPM-V-int4 2024-06-21 16:26:41,934 - INFO -...