Qwen3 support

Open Minami-su opened this issue 7 months ago • 1 comments

model = AutoAWQForCausalLM.from_pretrained(model_path, low_cpu_mem_usage=True, use_cache=False, device_map={"": "cpu"},offload_folder="offload_folder",max_memory=memory_config) File "/data/jcxy/haolu/anaconda3/envs/haolu/lib/python3.10/site-packages/awq/models/auto.py", line 70, in from_pretrained model_type = check_and_get_model_type( File "/data/jcxy/haolu/anaconda3/envs/haolu/lib/python3.10/site-packages/awq/models/auto.py", line 48, in check_and_get_model_type raise TypeError(f"{config.model_type} isn't supported yet.") TypeError: qwen3 isn't supported yet.

Apr 29 '25 03:04 Minami-su

The PR is already ready. I also need this PR to be merged into the main branch.

link

Apr 29 '25 04:04 hyunw55