bluescv

Results 2 comments of


                                            bluescv

[Bug]: chatGLM3-6B加载本地权重文件

我遇到了类似情况，后来发现是因为配置文件里device默认是CPU，需要显式指定为cuda。程序表现为卡住可能是因为CPU推理极慢导致的。

if tokenizer.eos_token_id not in stop_token_ids: AttributeError: 'NoneType' object has no attribute 'eos_token_id'

> Please provide some startup logs. I have encoutered the same problem. My startup logs: ``` ========== == CUDA == ========== CUDA Version 12.1.0 Container image Copyright (c) 2016-2023, NVIDIA...