PENet_ICRA2021 icon indicating copy to clipboard operation
PENet_ICRA2021 copied to clipboard

Ran PENet pre-trained model and results do not match Kitti benchmark depth completion page

Open manifischer opened this issue 2 years ago • 4 comments

Thank you very much for a very interesting paper. I have run the PENet pre-trained model you've provided in evaluation mode on the cropped image. in the results the code provided (val.csv under results) I got RMSE=757.197 MAE=209.001, compared to RMSE=730.08 MAE=210.55 as it appears in the Kitti benchmark page. IIs there a different PENet model that matches the submitted results? or there is something in the parameters that I put wrong (I kept the parameters as is in this repository). Thanks a lot, Mani

manifischer avatar Oct 31 '21 13:10 manifischer

Thanks for your interest! It's the same model as it is benchmarked on test set while validated on val set. You could also refer to this issue.

JUGGHM avatar Nov 01 '21 01:11 JUGGHM

Thanks a lot, missed the issue you referred to

manifischer avatar Nov 01 '21 05:11 manifischer

how to use penet pre-trained model,why it name is end with .tar it seems cant be loaded by "checkpoint = torch.load(args.evaluate, map_location=device)"

kingLCH avatar Sep 05 '22 05:09 kingLCH

how to use penet pre-trained model,why it name is end with .tar it seems cant be loaded by "checkpoint = torch.load(args.evaluate, map_location=device)"

Thanks for your interest! I am afraid taht it is an inherited bug and you can fix it yourself.

JUGGHM avatar Sep 06 '22 09:09 JUGGHM