UVM-Net icon indicating copy to clipboard operation
UVM-Net copied to clipboard

How long does it take to train ?

Open cvbird opened this issue 2 years ago • 5 comments

Hi zzr, thank you for sharing this repo. I wonder how long does it take to train your model on the RESIDE-OUT dataset. I trained with 4 GPUs, and it took around 9 hours for one epoch on RESIDE-OUT dataset. I wonder whether the time cost matches your experiment, as you announced the training setting was consisted with Vision Transformers for Single Image Dehazing which trained 30 epochs. So in my experiment, it may take 30*9=270 hours = 11.25 days (too looooooooooong).

Thanks again.

cvbird avatar Mar 01 '24 15:03 cvbird

We were using 8 V100s and it took just 3 days. If you think the loss is not dropping anymore, try to stop and test it.

zzr-idam avatar Mar 01 '24 15:03 zzr-idam

You can use our model to test it on a small number of datasets such as set5 to evaluate its capabilities.

zzr-idam avatar Mar 01 '24 15:03 zzr-idam

Currently, our model is used in the CVPR2024 workshop.

zzr-idam avatar Mar 01 '24 15:03 zzr-idam

Hi zzr, thank you for sharing this repo. I wonder how long does it take to train your model on the RESIDE-OUT dataset. I trained with 4 GPUs, and it took around 9 hours for one epoch on RESIDE-OUT dataset. I wonder whether the time cost matches your experiment, as you announced the training setting was consisted with Vision Transformers for Single Image Dehazing which trained 30 epochs. So in my experiment, it may take 30*9=270 hours = 11.25 days (too looooooooooong).

Thanks again.

What is your GPU version?

zzr-idam avatar Mar 01 '24 15:03 zzr-idam

Hi zzr, thank you for sharing this repo. I wonder how long does it take to train your model on the RESIDE-OUT dataset. I trained with 4 GPUs, and it took around 9 hours for one epoch on RESIDE-OUT dataset. I wonder whether the time cost matches your experiment, as you announced the training setting was consisted with Vision Transformers for Single Image Dehazing which trained 30 epochs. So in my experiment, it may take 30*9=270 hours = 11.25 days (too looooooooooong). Thanks again.

What is your GPU version?

V100 32G too. By the way, did you change the batch size ?

cvbird avatar Mar 01 '24 16:03 cvbird