Depth-Completion
Depth-Completion copied to clipboard
tsunghan-wu
MAE and RMSE
I find that MAE and RMSE should use the number of observed pixels in labels as divisor. But you use the number (320x256) for evaluation. Could you explain it? Thank you!
Hi,
Yes as you've mentioned, we indeed use the number of observed pixels in evaluation. Our implementation can be shown here. We first calculate the number of unobserved pixels and then calculate # of all pixels - # of unobserved. (where # of all pixels = 320x256) Feel free if you have any further questions. Thanks!
Best Regards, Tsung-Han Wu
It's kind of you! I still have some questions about it. L1 and RMSE use ''np.mean'' (line 82 and 83)in your code, which means the divisor is "320x256". The number of observed pixels "N" you mentioned are only used for "delta_*"(line 85-89), instead of L1 and RMSE. That's my confusion. Thank you!
Hi,
Thanks for your great findings! It seems that our implementation might be incorrect. However, I don't think it would affect the comparison results between these depth completion methods. Sincerely sorry to make you confused.
Best Regards, Tsung-Han Wu