SurenderSardana99

while , quantize model Using llm deploy , i am also getting issue lmdeploy lite auto_awq ./llama2-chat-7b-w4 --work-dir ./llama2-chat-7b-4bit Traceback (most recent call last): File "/home/userdata/.local/bin/lmdeploy", line 8, in sys.exit(run())...