SVD_Xtend icon indicating copy to clipboard operation
SVD_Xtend copied to clipboard

请问下BF16是怎么执行的,我执行有报错,帮看下

Open zhanghaobucunzai opened this issue 10 months ago • 0 comments

Traceback (most recent call last): File "train_svd.py", line 1262, in main() File "train_svd.py", line 1089, in main model_pred = unet( File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 1501, in _call_impl return forward_call(*args, **kwargs) File "/usr/local/lib/python3.8/dist-packages/deepspeed/utils/nvtx.py", line 15, in wrapped_fn ret_val = func(*args, **kwargs) File "/usr/local/lib/python3.8/dist-packages/deepspeed/runtime/engine.py", line 1833, in forward loss = self.module(*inputs, **kwargs) File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 1501, in _call_impl return forward_call(*args, **kwargs) File "/home/workspace/swx689421/diffusers/src/diffusers/models/unets/unet_spatio_temporal_condition.py", line 409, in forward emb = self.time_embedding(t_emb) File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 1501, in _call_impl return forward_call(*args, **kwargs) File "/home/workspace/swx689421/diffusers/src/diffusers/models/embeddings.py", line 228, in forward sample = self.linear_1(sample) File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 1501, in _call_impl return forward_call(*args, **kwargs) File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/linear.py", line 114, in forward return F.linear(input, self.weight, self.bias) RuntimeError: mat1 and mat2 must have the same dtype

zhanghaobucunzai avatar Apr 26 '24 02:04 zhanghaobucunzai