Metric3D icon indicating copy to clipboard operation
Metric3D copied to clipboard

Ground Truth Depth Image not loading correctly in fine-tuning

Open Gear-dev-sudo opened this issue 7 months ago • 2 comments

Hi all, Thanks for the amazing work!

However, when I tried to fine-tune on your model, the ground truth depth which I had processed into 16-bit representations in png images with depth scaling set to my value, the fine-tuning process I observed in tensorboard {rgb,pred_depth, gt_depth} image Indicates that the gt depth miss information in the bottom part, which my originial data actually have.

Additionally, why are all of the images shown on tensorboard all cropped to a bottom part of the image? Is this normal?

I Largely followed this post for fine-tuning #105

This is the command I used :

 python3 mono/tools/train.py \
         /home/Metric3D/training/mono/configs/RAFTDecoder/vit.raft5.giant2.kitti.py \
        --use-tensorboard \
        --experiment_name test1 \
        --load-from /home/Metric3D/models/metric_depth_vit_giant2_800k.pth \
        --seed 42 \
        --launcher None

Gear-dev-sudo avatar Jul 23 '24 15:07 Gear-dev-sudo