Exception: model baichuan2-13b@huggingface(192.168.30.2:5000) start failed

[cristianohello]

Search before asking

• [X] I had searched in the issues and found no similar issues.

Operating system information

Linux

Python version information

3.10

DB-GPT version

main

Related scenes

• [X] Chat Data
• [X] Chat Excel
• [X] Chat DB
• [X] Chat Knowledge
• [ ] Model Management
• [ ] Dashboard
• [ ] Plugins

Installation Information

• [X] Installation From Source

• [ ] Docker Installation

• [ ] Docker Compose Installation

• [ ] Cluster Installation

• [ ] AutoDL Image

• [ ] Other

Device information

A6000

Models information

baichuan2-23B

What happened

无

What you expected to happen

无

How to reproduce

无

Additional context

无

Are you willing to submit PR?

• [X] Yes I am willing to submit a PR!

[cristianohello]

执行python3 pilot/server/dbgpt_server.py 报错：Exception: model baichuan2-13b@huggingface(192.168.30.2:5000) start failed, BaichuanPreTrainedModel._set_gradient_checkpointing() gotan unexpected keyword argument 'enable'

[paul-yangmy]

降级transformers==4.33.1 and tokenizers==0.13.3 https://github.com/baichuan-inc/Baichuan2/issues/251

[github-actions[bot]]

This issue has been marked as stale, because it has been over 30 days without any activity.

[github-actions[bot]]

This issue bas been closed, because it has been marked as stale and there has been no activity for over 7 days.