chatglm2_finetuning icon indicating copy to clipboard operation
chatglm2_finetuning copied to clipboard

AssertionError: quantization ptv2 not support

Open anerg2046 opened this issue 2 years ago • 1 comments

我只是修改了constant_map.py最后为train_model_config = train_info_models['chatglm2-6b-32k-int4']

'chatglm2-6b-32k-int4': {
    'model_type': 'chatglm2',
    'model_name_or_path': '/data/ChatGLM/pre_model/chatglm2-6b-32k-int4',
    'config_name': '/data/ChatGLM/pre_model/chatglm2-6b-32k-int4/config.json',
    'tokenizer_name': '/data/ChatGLM/pre_model/chatglm2-6b-32k-int4',
},

相关配置是这样的。

最后报错:AssertionError: quantization ptv2 not support

anerg2046 avatar Sep 07 '23 14:09 anerg2046