AutoAWQ icon indicating copy to clipboard operation
AutoAWQ copied to clipboard

support aya vision

Open devops724 opened this issue 9 months ago • 0 comments

on run quantize for aya vision i get this error Traceback (most recent call last): File "/home/user/workspace/api/document/quantize.py", line 9, in model = AutoAWQForCausalLM.from_pretrained(model_path) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/miniconda3/lib/python3.12/site-packages/awq/models/auto.py", line 76, in from_pretrained model_type = check_and_get_model_type( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/miniconda3/lib/python3.12/site-packages/awq/models/auto.py", line 51, in check_and_get_model_type raise TypeError(f"{config.model_type} isn't supported yet.") TypeError: aya_vision isn't supported yet.

devops724 avatar Mar 22 '25 23:03 devops724