[BUG] 启动 MiniChat-2-3B -t minichat 的LLM服务报错 ERROR | stderr | tokenizer = cls(*init_inputs, **init_kwargs)

[daonidedie]

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

• [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

• [X] 我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

sudo bash ./run.sh -c local -i 0 -b hf -m MiniChat-2-3B -t minichat 3B remote

期望行为 | Expected Behavior

能够正常运行

运行环境 | Environment

- OS:
- NVIDIA Driver:
- CUDA:
- docker:
- docker-compose:
- NVIDIA GPU:
- NVIDIA GPU Memory:

QAnything日志 | QAnything logs

anything-container-local | Embedding 和 Rerank 服务已准备就绪！(7.5/8) qanything-container-local | 2024-03-27 16:19:16 | ERROR | stderr | tokenizer = cls(*init_inputs, **init_kwargs) qanything-container-local | 2024-03-27 16:19:16 | ERROR | stderr | File "/usr/local/lib/python3.10/dist-packages/transformers/models/llama/tokenization_llama.py", line 178, in init qanything-container-local | 2024-03-27 16:19:16 | ERROR | stderr | self.sp_model = self.get_spm_processor(kwargs.pop("from_slow", False)) qanything-container-local | 2024-03-27 16:19:16 | ERROR | stderr | File "/usr/local/lib/python3.10/dist-packages/transformers/models/llama/tokenization_llama.py", line 203, in get_spm_processor qanything-container-local | 2024-03-27 16:19:16 | ERROR | stderr | tokenizer.Load(self.vocab_file) qanything-container-local | 2024-03-27 16:19:16 | ERROR | stderr | File "/usr/local/lib/python3.10/dist-packages/sentencepiece/init.py", line 905, in Load qanything-container-local | 2024-03-27 16:19:16 | ERROR | stderr | return self.LoadFromFile(model_file) qanything-container-local | 2024-03-27 16:19:16 | ERROR | stderr | File "/usr/local/lib/python3.10/dist-packages/sentencepiece/init.py", line 310, in LoadFromFile qanything-container-local | 2024-03-27 16:19:16 | ERROR | stderr | return _sentencepiece.SentencePieceProcessor_LoadFromFile(self, arg) qanything-container-local | 2024-03-27 16:19:16 | ERROR | stderr | TypeError: not a string qanything-container-local | % Total % Received % Xferd Average Speed Time Time Time Current qanything-container-local | Dload Upload Total Spent Left Speed 100 13 100 13 0 0 4629 0 --:--:-- --:--:-- --:--:-- 6500 qanything-container-local | The llm service is starting up, it can be long... you have time to make a coffee :) qanything-container-local | LLM 服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :) qanything-container-local | % Total % Received % Xferd Average Speed Time Time Time Current qanything-container-local | Dload Upload Total Spent Left Speed

复现方法 | Steps To Reproduce

sudo bash ./run.sh -c local -i 0 -b hf -m MiniChat-2-3B -t minichat

备注 | Anything else?

No response

[xiaoma1990-git]

我的报错和你差不多 请问解决了吗 下面是我的报错：