Chinese-LLaMA-Alpaca icon indicating copy to clipboard operation
Chinese-LLaMA-Alpaca copied to clipboard

Lora训练时节省显存删除--modules_to_save ${modules_to_save} \和--gradient_checkpointing \依旧报错

Open jjyu-ustc opened this issue 2 years ago • 1 comments

提示:将[ ]中填入x,表示打对钩。提问时删除这行。只保留符合的选项。

详细描述问题

第二训练阶段,fine-tuning 模型的时候 Lora训练时,为了节省显存删除--modules_to_save ${modules_to_save} \和--gradient_checkpointing \依旧报错

请尽量具体地描述您遇到的问题,必要时给出运行命令。这将有助于我们更快速地定位问题所在。 image

运行截图或日志

image

必查项目(前三项只保留你要问的)

  • [ ] 基础模型:Alpaca-Plus
  • [ ] 运行系统: Linux
  • [ ] 问题分类:模型训练与精调
  • [ ] (必选)由于相关依赖频繁更新,请确保按照Wiki中的相关步骤执行
  • [ ] (必选)我已阅读FAQ章节并且已在Issue中对问题进行了搜索,没有找到相似问题和解决方案

jjyu-ustc avatar May 21 '23 13:05 jjyu-ustc

请删除--modules_to_save ${modules_to_save} \--gradient_checkpointing \两行(而不是注释掉),再试一下吧

airaria avatar May 21 '23 13:05 airaria

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your consideration.

github-actions[bot] avatar May 28 '23 22:05 github-actions[bot]

Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.

github-actions[bot] avatar May 31 '23 22:05 github-actions[bot]