MiniCPM icon indicating copy to clipboard operation
MiniCPM copied to clipboard

使用llamafactory微调报错

Open lifelsl opened this issue 1 year ago • 0 comments

我在使用llamafactory微调cpm3时发生了这个错误 [rank0]: Traceback (most recent call last): [rank0]: File "/data2/liushuliang/MiniCPM/LLaMA-Factory/src/train.py", line 28, in [rank0]: main() [rank0]: File "/data2/liushuliang/MiniCPM/LLaMA-Factory/src/train.py", line 19, in main [rank0]: run_exp() [rank0]: File "/data2/liushuliang/MiniCPM/LLaMA-Factory/src/llamafactory/train/tuner.py", line 50, in run_exp [rank0]: run_sft(model_args, data_args, training_args, finetuning_args, generating_args, callbacks) [rank0]: File "/data2/liushuliang/MiniCPM/LLaMA-Factory/src/llamafactory/train/sft/workflow.py", line 47, in run_sft [rank0]: dataset_module = get_dataset(template, model_args, data_args, training_args, stage="sft", **tokenizer_module) [rank0]: File "/data2/liushuliang/MiniCPM/LLaMA-Factory/src/llamafactory/data/loader.py", line 248, in get_dataset [rank0]: dataset = _get_merged_dataset(data_args.dataset, model_args, data_args, training_args, stage) [rank0]: File "/data2/liushuliang/MiniCPM/LLaMA-Factory/src/llamafactory/data/loader.py", line 154, in _get_merged_dataset [rank0]: for dataset_attr in get_dataset_list(dataset_names, data_args.dataset_dir): [rank0]: File "/data2/liushuliang/MiniCPM/LLaMA-Factory/src/llamafactory/data/parser.py", line 94, in get_dataset_list [rank0]: raise ValueError("Cannot open {} due to {}.".format(config_path, str(err))) [rank0]: ValueError: Cannot open data/dataset_info.json due to [Errno 2] No such file or directory: 'data/dataset_info.json'. [rank1]: Traceback (most recent call last): [rank1]: File "/data2/liushuliang/MiniCPM/LLaMA-Factory/src/llamafactory/data/parser.py", line 90, in get_dataset_list [rank1]: with open(config_path, "r") as f: [rank1]: FileNotFoundError: [Errno 2] No such file or directory: 'data/dataset_info.json' 但是我已经配置过这些文件了 屏幕截图 2024-09-15 113145

屏幕截图 2024-09-15 113209 屏幕截图 2024-09-15 113234 请问一下我的问题出现在哪里

lifelsl avatar Sep 15 '24 03:09 lifelsl