SimpleTuner icon indicating copy to clipboard operation
SimpleTuner copied to clipboard

AttributeError: 'DistributedDataParallel' object has no attribute 'dtype'

Open magicwang1111 opened this issue 6 months ago • 11 comments

  • Total optimization steps = 3000
  • Total optimization steps remaining = 3000 Epoch 1/3, Steps: 0%| | 0/3000 [00:00<?, ?it/s]'DistributedDataParallel' object has no attribute 'dtype' Traceback (most recent call last): File "/mnt/data1/wangxi/SimpleTuner/train.py", line 2756, in main() File "/mnt/data1/wangxi/SimpleTuner/train.py", line 2060, in main dtype=transformer.dtype, device=accelerator.device File "/home/wangxi/miniconda3/envs/flux/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1729, in getattr raise AttributeError(f"'{type(self).name}' object has no attribute '{name}'") AttributeError: 'DistributedDataParallel' object has no attribute 'dtype'

Epoch 1/3, Steps: 0%| | 0/3000 [00:00<?, ?it/s]

(flux) [wangxi@v100-4 SimpleTuner]$ (flux) [wangxi@v100-4 SimpleTuner]$ git pull Already up to date.

magicwang1111 avatar Aug 08 '24 03:08 magicwang1111