CPM-1-Finetune-Text-Generation

CPM-1-Finetune-Text-Generation copied to clipboard

CPM模型无法下载，hugging face上下载的CPM并没有80000文件夹

1

你好这个微调可以使用别的LLM吗？ 比如百川 千问之类的

zswodegit

@zhenhao-huang 你好，请问CPM模型能分享一下吗 https://cpm.baai.ac.cn/ 这个链接打不开了呢

447428054

type_error,load_optimizer_states=False好像没起作用怎么回事

3

Traceback (most recent call last): File "finetune_text_generation.py", line 324, in main() File "finetune_text_generation.py", line 208, in main model, optimizer, lr_scheduler = setup_model_and_optimizer(args) File "/CPM/utils.py", line 510, in setup_model_and_optimizer args.iteration =...

ZORO-Q

如何使用单机单卡进行训练？

4

由于本人条件有限，只有一台机器一个显卡，完成好配置后，无法解决下面的NCCL error： Traceback (most recent call last): File "finetune_text_generation_src.py", line 324, in main() File "finetune_text_generation_src.py", line 208, in main model, optimizer, lr_scheduler = setup_model_and_optimizer(args) File "/root/workspace/CPM-1-Finetune-Text-Generation/utils.py", line 493, in setup_model_and_optimizer...

waduhekxx

使用4卡，利用行业数据进行微调，loss初始几轮不降低

28

0%|▏ | 36/38862 [05:11

DTDXG

使用该项目微调CPM-distill模型，无法加载

13

由于没有足够显存，因此准备微调CPM-distill（官方发布CPM-LM(2.6B)模型的蒸馏版本），使用该项目时却发现无法加载模型，报尺寸错误，请求帮忙分析下是什么原因 ``` (liubiao2) kingsoft@k8s-w-10-13-84-7:~/liubiao2/smartWriter/CPM-1-Finetune$ bash scripts/novel/finetune_novel_fp32.sh using world size: 1 and model-parallel size: 1 > using dynamic loss scaling > initializing model parallel with size 1 [2021-12-07 10:08:46,970] [INFO] [checkpointing.py:795:_configure_using_config_file]...

Biaocsu