KinokoY

加载微调后模型时报错object of type 'QuantState' has no len()

9

使用官方的微调脚本和数据集，用QLora方法进行的微调。 !python cli_demo.py --from_pretrained 'checkpoints/finetune-visualglm-6b-11-28-13-22' 运行上面代码时报错： [2023-11-28 15:04:33,198] [INFO] [real_accelerator.py:158:get_accelerator] Setting ds_accelerator to cuda (auto detect) 2023-11-28 15:04:36.555529: E tensorflow/compiler/xla/stream_executor/cuda/cuda_dnn.cc:9342] Unable to register cuDNN factory: Attempting to register factory for...