LLaMA-Factory icon indicating copy to clipboard operation
LLaMA-Factory copied to clipboard

使用unsloth报错

Open Harris-Xie opened this issue 1 week ago • 0 comments

Reminder

  • [x] I have read the above rules and searched the existing issues.

System Info

使用unsloth报错: [rank5]: Traceback (most recent call last): [rank5]: File "/disks/sdb/user_space/yujingsong/jiangxinyu/anaconda3/envs/huaibing_2/lib/python3.11/site-packages/unsloth_zoo/compiler.py", line 259, in create_new_function [rank5]: new_module = importlib.import_module(UNSLOTH_COMPILE_LOCATION + "." + name) [rank5]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank5]: File "/disks/sdb/user_space/yujingsong/jiangxinyu/anaconda3/envs/huaibing_2/lib/python3.11/importlib/__init__.py", line 126, in import_module [rank5]: return _bootstrap._gcd_import(name[level:], package, level) [rank5]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank5]: File "<frozen importlib._bootstrap>", line 1206, in _gcd_import [rank5]: File "<frozen importlib._bootstrap>", line 1178, in _find_and_load [rank5]: File "<frozen importlib._bootstrap>", line 1128, in _find_and_load_unlocked [rank5]: File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed [rank5]: File "<frozen importlib._bootstrap>", line 1206, in _gcd_import [rank5]: File "<frozen importlib._bootstrap>", line 1178, in _find_and_load [rank5]: File "<frozen importlib._bootstrap>", line 1142, in _find_and_load_unlocked [rank5]: ModuleNotFoundError: No module named 'unsloth_compiled_cache'

Reproduction

Put your message here.

我的命令预览如下: llamafactory-cli train
--stage sft
--do_train True
--model_name_or_path qwen2.5-3b-instruct
--preprocessing_num_workers 16
--finetuning_type lora
--template qwen
--flash_attn auto
--use_unsloth True
--dataset_dir data
--dataset DISC
--cutoff_len 2048
--learning_rate 5e-05
--num_train_epochs 3.0
--max_samples 100000
--per_device_train_batch_size 8
--gradient_accumulation_steps 4
--lr_scheduler_type cosine
--max_grad_norm 1.0
--logging_steps 5
--save_steps 600
--warmup_steps 0
--packing False
--report_to none
--output_dir saves/Qwen2.5-3B-Instruct/lora/train_2025-02-14-14-13-28
--bf16 True
--plot_loss True
--trust_remote_code True
--ddp_timeout 180000000
--include_num_input_tokens_seen True
--optim adamw_torch
--lora_rank 8
--lora_alpha 16
--lora_dropout 0
--lora_target all

Others

No response

Harris-Xie avatar Feb 14 '25 14:02 Harris-Xie