Easy-Wav2Lip icon indicating copy to clipboard operation
Easy-Wav2Lip copied to clipboard

RuntimeError: Input type (torch.cuda.FloatTensor) and weight type (torch.FloatTensor) should be the same

Open AlexHe99 opened this issue 6 months ago • 2 comments

I am trying to use AMD GPU and ROCm to run it. But I got this issue when try ./run_loop.sh

(wav2lip) amd@AIG-PM:/DATA/Easy-Wav2Lip$ pip list | grep torch pytorch-triton-rocm 3.0.0 torch 2.4.0+rocm6.1 torchaudio 2.4.0+rocm6.1 torchvision 0.19.0+rocm6.1 (wav2lip) amd@AIG-PM:/DATA/Easy-Wav2Lip$ python /DATA/query_gpu.py 2.4.0+rocm6.1 Using GPU: AMD Radeon PRO W7900 GPU details: _CudaDeviceProperties(name='AMD Radeon PRO W7900', major=11, minor=0, gcnArchName='gfx1100', total_memory=46064MB, multi_processor_count=48)

(wav2lip) amd@AIG-PM:/DATA/Easy-Wav2Lip$ ./run_loop.sh opening GUI Saving config Starting Easy-Wav2Lip... Processing vTest.mp4 using TEn_sya.wav for audio imports loaded! analysing audio... 675 frames to process Using face detection data from last input Starting... Processing Wav2Lip: 0%| | 0/760 [00:01<?, ?it/s] Traceback (most recent call last): File "/DATA/Easy-Wav2Lip/inference.py", line 781, in main() File "/DATA/Easy-Wav2Lip/inference.py", line 703, in main pred = model(mel_batch, img_batch) File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl return self._call_impl(*args, **kwargs) File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1562, in _call_impl return forward_call(*args, **kwargs) File "/DATA/Easy-Wav2Lip/models/wav2lip.py", line 96, in forward audio_embedding = self.audio_encoder(audio_sequences) # B, 512, 1, 1 File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl return self._call_impl(*args, **kwargs) File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1562, in _call_impl return forward_call(*args, **kwargs) File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/container.py", line 219, in forward input = module(input) File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl return self._call_impl(*args, **kwargs) File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1562, in _call_impl return forward_call(*args, **kwargs) File "/DATA/Easy-Wav2Lip/models/conv.py", line 16, in forward out = self.conv_block(x) File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl return self._call_impl(*args, **kwargs) File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1562, in _call_impl return forward_call(*args, **kwargs) File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/container.py", line 219, in forward input = module(input) File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl return self._call_impl(*args, **kwargs) File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1562, in _call_impl return forward_call(*args, **kwargs) File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 458, in forward return self._conv_forward(input, self.weight, self.bias) File "/home/amd/anaconda3/envs/wav2lip/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 454, in _conv_forward return F.conv2d(input, weight, bias, self.stride, RuntimeError: Input type (torch.cuda.FloatTensor) and weight type (torch.FloatTensor) should be the same Processing failed! :( see line above 👆 Consider searching the issues tab on the github: https://github.com/anothermartz/Easy-Wav2Lip/issues

AlexHe99 avatar Aug 20 '24 03:08 AlexHe99