Number of GPUs for training of 4D-DS-Net

[LarsKreuzberg]

Hi! Thanks for sharing your great project! I have a question regarding 4D-DS-Net. I tried to finetune the backbone of 4D-DS-Net. I have the possibility to train on 4 Geforce GTX 1080Ti. Unfortunately even on 4 Geforce GTX 1080Ti I am getting a "CUDA OUT OF MEMORY ERROR". On how many GPUs you trained the 4D-DS-Net? Is there a possibility that you share your pretrained models for 4D-DS-Net? Thanks in advance!

[hongfz16]

Thank you for your interest. We trained the 4D-DS-Net using 4 NVIDIA V100 GPUs which have 32GB memory each. So unfortunately, GTX 1080Ti will not be enough to train our recommended setting. One possible solution is to tune down the number of points using in dynamic shifting module. You can adjust the number in the config file here and here. But from my experiment, tuning down the number of points will affect the final results.

As for the pre-trained model for 4D-DS-Net, I will upload it soon.

[hongfz16]

Uploaded the pre-train model. Go check it out in README!

[LarsKreuzberg]

Many thanks for sharing your final model for 4D-DS-Net! Could you maybe also share your finetuned backbone for 4D-DS-Net? This pretrained model is called "checkpoint_epoch_20_0.622_0.572_0.620.pth" in ./scripts/release/4d-dsnet/train_dsnet_multi_frames_2.sh.