DB-GPT
DB-GPT copied to clipboard
[Feature]:使用CHATGLM-6B支持加载前置的PTUNING模型吗
Is your feature request related to a problem? Please describe. 目前版本测试了可以使用CHATGLM-6B,不过我试了下想加入PTUNING的模型,不过没有成功。不知道DB-GPT近期会不会加如这个功能 Describe the solution you'd like A clear and concise description of what you want to happen.
Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.
Additional context Add any other context or screenshots about the feature request here.
下个月我们会提供一系列的微调脚本,我们会主要关注vicuna,falcon相关的微调。 关于ChatGLM的微调可以关注下ChatGLM的官方https://github.com/THUDM/ChatGLM-6B,官方项目中有一些ptuning的介绍。
We will provide various fine-tuning scripts next month, focusing on vicuna and falcon series models for fine-tuning. The pturning of chatglm can be followed from https://github.com/THUDM/ChatGLM-6B fine-tuning instructions in this project
Already supported, https://github.com/eosphoros-ai/DB-GPT-Hub