wav2lip_288x288 icon indicating copy to clipboard operation
wav2lip_288x288 copied to clipboard

What indicator represents the end of training hq_wav2lip_sam_train?

Open mrhanCH opened this issue 9 months ago • 4 comments

Thank you for your excellent work. May I ask what indicator represents when I can manually end the training of hq_wav2lip_sam_train? Or will the training process end automatically?

mrhanCH avatar Apr 26 '24 13:04 mrhanCH

Step 129 | L1: 0.139 | Vgg: 0.4578 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.005001, Train: 9.415 Step 130 | L1: 0.1386 | Vgg: 0.4565 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.006001, Train: 9.395 Step 131 | L1: 0.1384 | Vgg: 0.4553 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.005002, Train: 9.412 Step 132 | L1: 0.1385 | Vgg: 0.4548 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.005014, Train: 9.39 Step 133 | L1: 0.1383 | Vgg: 0.454 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.005001, Train: 9.397

This is my training progress, I feel it's not quite normal.

mrhanCH avatar Apr 26 '24 13:04 mrhanCH

did you train syncnet ?

ashishjamarkattel avatar Apr 27 '24 14:04 ashishjamarkattel

Step 129 | L1: 0.139 | Vgg: 0.4578 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.005001, Train: 9.415 Step 130 | L1: 0.1386 | Vgg: 0.4565 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.006001, Train: 9.395 Step 131 | L1: 0.1384 | Vgg: 0.4553 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.005002, Train: 9.412 Step 132 | L1: 0.1385 | Vgg: 0.4548 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.005014, Train: 9.39 Step 133 | L1: 0.1383 | Vgg: 0.454 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.005001, Train: 9.397

This is my training progress, I feel it's not quite normal.

you can check the output for the stop, originall loss should be less less than 0.2. If syncnet is trained well.

ashishjamarkattel avatar Apr 27 '24 14:04 ashishjamarkattel

Step 129 | L1: 0.139 | Vgg: 0.4578 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.005001, Train: 9.415 Step 130 | L1: 0.1386 | Vgg: 0.4565 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.006001, Train: 9.395 Step 131 | L1: 0.1384 | Vgg: 0.4553 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.005002, Train: 9.412 Step 132 | L1: 0.1385 | Vgg: 0.4548 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.005014, Train: 9.39 Step 133 | L1: 0.1383 | Vgg: 0.454 | SW: 0.03 | Sync: 0.0 | DW: 0.0 | Percep: 0.0 | Fake: 0.0, Real: 0.0 | Load: 0.005001, Train: 9.397 This is my training progress, I feel it's not quite normal.

you can check the output for the stop, originall loss should be less less than 0.2. If syncnet is trained well.

Syncnet trained to 0.3, which label is the origin loss? L1? thanks

mrhanCH avatar Apr 28 '24 13:04 mrhanCH