Wav2Lip icon indicating copy to clipboard operation
Wav2Lip copied to clipboard

train wav2lip288 in a low loss,but it not perform well in inference!

Open killnice66 opened this issue 1 year ago • 2 comments

i use hdtf for wav2lip288 training,nearly 170 0000 pictures ,16hours my syncnet eval loss is 0.3 and my L1 eval loss is currently 0.019051536196276822 and my sync eval loss is 0.18783933469512834 which seems good ,but my inference product the original frame with some blue dots on them ,what's the potential problem in it? image

my inference video (which is the same lip as original video) https://github.com/Rudrabha/Wav2Lip/assets/74774674/8e794215-a9b6-4c08-ac16-170f8fefef70

killnice66 avatar Dec 20 '23 14:12 killnice66

any updates?

Ronincod3 avatar Feb 24 '24 18:02 Ronincod3

i use hdtf for wav2lip288 training,nearly 170 0000 pictures ,16hours my syncnet eval loss is 0.3 and my L1 eval loss is currently 0.019051536196276822 and my sync eval loss is 0.18783933469512834 which seems good ,but my inference product the original frame with some blue dots on them ,what's the potential problem in it? image

my inference video (which is the same lip as original video) https://github.com/Rudrabha/Wav2Lip/assets/74774674/8e794215-a9b6-4c08-ac16-170f8fefef70

Hi br. The video looks like out of sync.

LiuJiaqi0505 avatar Apr 28 '24 12:04 LiuJiaqi0505