shaoyan1223

微调使用zero3在载入vision_tower出现报错，当前是不支持zero3吗？

2

Traceback (most recent call last): File "/opt/tiger/internlm-xcomposer/finetune/finetune.py", line 311, in train() File "/opt/tiger/internlm-xcomposer/finetune/finetune.py", line 242, in train model = transformers.AutoModelForCausalLM.from_pretrained( File "/home/tiger/.local/lib/python3.9/site-packages/transformers/models/auto/auto_factory.py", line 479, in from_pretrained return model_class.from_pretrained( File "/home/tiger/.local/lib/python3.9/site-packages/transformers/modeling_utils.py",...