wav2lip_288x288 icon indicating copy to clipboard operation
wav2lip_288x288 copied to clipboard

LOSS stuck arount 0.69

Open ashishjamarkattel opened this issue 1 year ago • 7 comments

I got an strange issue while training color_sync net. I have read your other issue for filtering the dataset. to [-1, 1 ] i really dont understand this. How do we do that.

  1. I have cut the video into less than 5sec.
  2. resolution of video is 760px to 1080px.
  3. Lr is 1e-4 also tried 1e-5
  4. batch size is 16.

ashishjamarkattel avatar Jan 15 '24 16:01 ashishjamarkattel

Hi! [-1, 1] refers to are offset values between audio and video that you get after using code from https://github.com/joonson/syncnet_python on your videos.

I recommend running run_pipeline.py first, as it preprocesses video to make it suitable for syncnet, and then running run_syncnet.py from the same repo

NochnoyRitzar avatar Jan 16 '24 09:01 NochnoyRitzar

Thanks for the help. Is running those 2 command is enough ?

ashishjamarkattel avatar Jan 16 '24 16:01 ashishjamarkattel

Yes. There is another one which is run_visualize.py, but it's just for visualization purpose

NochnoyRitzar avatar Jan 16 '24 17:01 NochnoyRitzar

I have encountered the same problem, which is also not falling at 0.69. May I ask if you have solved it?

397688551 avatar Jan 18 '24 01:01 397688551

I have encountered the same problem, which is also not falling at 0.69. May I ask if you have solved it?

I am working on it. But i am not able to solve it still. Somewhere in case of mine syncnet_python not working for my avspeech dataset. Please let me know if you have solve it.

ashishjamarkattel avatar Jan 18 '24 12:01 ashishjamarkattel

I have encountered the same problem, which is also not falling at 0.69. May I ask if you have solved it?

I am working on it. But i am not able to solve it still. Somewhere in case of mine syncnet_python not working for my avspeech dataset. Please let me know if you have solve it. I have encountered the same problem, which is also not falling at 0.69. oh my ! May I ask if you have solved it?

drakitLiu avatar Apr 19 '24 12:04 drakitLiu

I have encountered the same problem, which is also not falling at 0.69. May I ask if you have solved it?

I am working on it. But i am not able to solve it still. Somewhere in case of mine syncnet_python not working for my avspeech dataset. Please let me know if you have solve it.

Hi ! did you have solved it?

drakitLiu avatar Apr 19 '24 12:04 drakitLiu