Chinese-LLaMA-Alpaca icon indicating copy to clipboard operation
Chinese-LLaMA-Alpaca copied to clipboard

请问现在市面上哪份代码可以直接finetune您这份模型呢~

Open hangzeli08 opened this issue 3 years ago • 3 comments

您的意思是是直接使用 https://github.com/tatsu-lab/stanford_alpaca 里面的train.py把基础模型换成您这个就可以finetune了吗~ 目前市面上有哪份代码或项目可以直接指令微调您的代码并取得不错的效果了吗~ 有推荐吗~

hangzeli08 avatar Apr 27 '23 07:04 hangzeli08

合并后的llama(alpaca)的hf权重,都可以根据现有的huggingface代码微调,比如transformers的run_clm.py

iMountTai avatar Apr 27 '23 13:04 iMountTai

合并后的权重就和普通llama没什么区别了

airaria avatar Apr 27 '23 13:04 airaria

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your consideration.

github-actions[bot] avatar May 05 '23 00:05 github-actions[bot]

Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.

github-actions[bot] avatar May 10 '23 00:05 github-actions[bot]