Langchain-Chatchat [BUG] 本地启动报错

问题描述 / Problem Description

本地启动报错，报错日志如下：

复现问题的步骤 / Steps to Reproduce

执行python startup.py -a
有一堆ERROR报错日志，无法访问本地80端口
将ChatGLM3-6B 和bge-large-zh目录放到chatGLM同级和子目录都不行

环境信息 / Environment Information

langchain-ChatGLM 版本/commit 号：v0.2.10
是否使用 Docker 部署（是/否）：否
使用的模型（ChatGLM2-6B / Qwen-7B 等）：ChatGLM3-6B
使用的 Embedding 模型（moka-ai/m3e-base 等）：BAAI/bge-large-zh
操作系统及版本 / Operating system and version: macos 13.6.4
Python 版本 / Python version: 3.11.6
其他相关环境信息 / Other relevant environment information:

附加信息 / Additional Information 添加与问题相关的任何其他信息 / Add any other information related to the issue.

May 15 '24 01:05 Belee05

To address the startup error you're encountering with python startup.py -a, here are some targeted steps to consider:

Verify Port 80 Availability: Use sudo lsof -i :80 to check if port 80 is already in use. If it is, either stop the conflicting process or choose another port for your application.
Run as Root: Since binding to port 80 on macOS requires root privileges, try executing the script with sudo.
Check Python and Dependencies: Ensure all dependencies are compatible with Python 3.11.6. Consider using a virtual environment to manage these dependencies.
Firewall and Permissions: Make sure the macOS firewall or any security software isn't blocking access to port 80.
Alternative Port: If not strictly required to use port 80, switch to an alternative port like 8080 by adjusting the port configuration in your script.
Review Error Logs: Examine the logs for specific error messages that could shed light on the issue. The exact error message from the traceback is crucial for diagnosing the problem.
Model Placement: Ensure the ChatGLM3-6B and bge-large-zh models are placed in a directory recognized by the MODEL_ROOT_PATH variable, following the directory structure required by the application.
Known Issues: Check if your issue aligns with known issues in Langchain-Chatchat version v0.2.10, such as issue #443, which reports startup errors.

By following these steps, you should be able to diagnose and potentially resolve the startup error. If the problem persists, providing more specific error messages from the logs can help in further troubleshooting.

Details

Sources

About Dosu This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

To continue the conversation, mention @dosu.

May 15 '24 01:05 dosubot[bot]

请问您解决这个问题了吗

May 15 '24 08:05 ZhuLingda

请问您解决这个问题了吗

没有。我在MODEL_ROOT_PATH中加了模型的路径，启动时也显示加载路径了，但还是会报错。最后一行报错：RuntimeError: Internal: could not parse ModelProto from /Users/ken.li/PycharmProjects/Langchain-Chatchat/chatglm3-6b/tokenizer.model 在issue中看到机器人回复修改tokenizer_config.json，里面的内容原本就是：

"auto_map": {
    "AutoTokenizer": [
      "tokenization_chatglm.ChatGLMTokenizer",
      null
    ]
  },

不知道哪里有问题

May 15 '24 08:05 Belee05

请问您解决这个问题了吗

没有。我在MODEL_ROOT_PATH中加了模型的路径，启动时也显示加载路径了，但还是会报错。最后一行报错：RuntimeError: Internal: could not parse ModelProto from /Users/ken.li/PycharmProjects/Langchain-Chatchat/chatglm3-6b/tokenizer.model 在issue中看到机器人回复修改tokenizer_config.json，里面的内容原本就是：
"auto_map": {
    "AutoTokenizer": [
      "tokenization_chatglm.ChatGLMTokenizer",
      null
    ]
  },
不知道哪里有问题

我将model_config.py中的MODEL_ROOT_PATH修改为chatglm的base dir后解决了这个问题，但是目前弹出了新的问题，是关于CUDA driver版本过时的问题，我正在解决

May 15 '24 10:05 ZhuLingda

这个问题已经被标记为 stale ，因为它已经超过 30 天没有任何活动。

Jun 14 '24 21:06 github-actions[bot]

Langchain-Chatchat Langchain-Chatchat copied to clipboard

[BUG] 本地启动报错

本地启动报错，报错日志如下：

Details

Langchain-Chatchat
Langchain-Chatchat copied to clipboard