Chen Song comments

Results 5 comments of


                                            Chen Song

Qwen2_5_VLForConditionalGeneration

> 我拉了最新代码编译部署就可以了 > > pip show transformers Name: transformers Version: 4.50.0.dev0 > > > Version: 4.49.0.dev0 hello, what's your autoawq version, I meet a incompatibility between transformers and autoawq

azure or vertex

> ENVs for AZURE GPT-4o (the feature is supported by the community): > > 1. AZURE_OPENAI_ENDPOINT > 2. AZURE_OPENAI_DEPLOYMENT_NAME > 3. OPENAI_API_VERSION > 4. Moreover, you need to set use_azure=True...

run Qwen2.5-VL-72B-Instruct-AWQ get error

I follow the https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct-AWQ instructions. pip install git+https://github.com/huggingface/transformers accelerate pip install qwen-vl-utils[decord]==0.0.8

run Qwen2.5-VL-72B-Instruct-AWQ get error

I meet a incompatibility between transformers and autoawq. The latest version of autoawq does not support the latest version of transformers, it only supports up to version 4.47.1, but qwen2.5vl...

run Qwen2.5-VL-72B-Instruct-AWQ get error

how to solve this problem?