Wav2Lip icon indicating copy to clipboard operation
Wav2Lip copied to clipboard

This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020.

Results 152 Wav2Lip issues
Sort by recently updated
recently updated
newest added

How can we create a real time Wav2Lip? For example from a wav file or live mic audio or TTS? Is it feasible using Wav2Lip? If yes, please provide the...

///(I don't understand python and its libraries. my knowledge is limited to ctrl c + v, thanks in advance) I installed the model and the checkpoint according to the instructions,...

Traceback (most recent call last): File "wav2lip_train.py", line 372, in train(device, model, train_data_loader, test_data_loader, optimizer, File "wav2lip_train.py", line 223, in train sync_loss = get_sync_loss(mel, g) File "wav2lip_train.py", line 196, in...

训练中文数据集时,运行color_syncnet_train.py,一直卡在0it【00:00,?it/s】怎么解决 ![image](https://github.com/Rudrabha/Wav2Lip/assets/58758728/93c08f5f-574a-4c8d-9090-bca5faf4ac79)

Traceback (most recent call last): File "color_syncnet_train.py", line 279, in <module> nepochs=hparams.nepochs) File "color_syncnet_train.py", line 163, in train optimizer.step() File "/home/user/anaconda3/envs/wav2lip/lib/python3.6/site-packages/torch/optim/optimizer.py", line 88, in wrapper return func(*args, **kwargs) File "/home/user/anaconda3/envs/wav2lip/lib/python3.6/site-packages/torch/autograd/grad_mode.py",...

The synthesized video has a transparent box at the mouth(合成好的视频人嘴处有透明的方框)

Traceback (most recent call last): File "/home/mk/Wav2Lip-master/inference.py", line 78, in face_detect predictions.extend(detector.get_detections_for_batch(np.array(images[i:i + batch_size]))) File "/home/mk/Wav2Lip-master/face_detection/api.py", line 66, in get_detections_for_batch detected_faces = self.face_detector.detect_from_batch(images.copy()) File "/home/mk/Wav2Lip-master/face_detection/detection/sfd/sfd_detector.py", line 42, in detect_from_batch bboxlists...

Do the video clips have to be less than 5 seconds? Can I cut them with the lengths in 4-7 seconds? thanks

当我下载好数据集并使用您的代码处理后发现一个文件夹中的图像来自不同的视频,这个是否正常? ![企业微信截图_20240328092201](https://github.com/Rudrabha/Wav2Lip/assets/78424820/a3efe907-62d7-4547-8cbb-95247da1f53d) 这个现象产生的原因是什么呢?有人遇到过吗?

when i follow your code to propraring LRS2 for training, i find the post-prepare data is confused! ![企业微信截图_20240328092201](https://github.com/Rudrabha/Wav2Lip/assets/78424820/fb150a73-db7c-4ece-a6a5-2351037febba) is this problem raised by multi-threading of python?