while quantizing the llava-7b model,an error occurred: AttributeError: 'NoneType' object has no attribute 'shape'

Open donghong1 opened this issue 11 months ago • 0 comments

Hello, I encountered the issue while quantizing the llava-7b model. An error occurred: AttributeError: 'NoneType' object has no attribute 'shape'. My versions are autoawq==0.2.8, tokenizers==0.21.0, and transformers==4.47.1.How can I to solve it?

Feb 17 '25 03:02 donghong1