EMAP icon indicating copy to clipboard operation
EMAP copied to clipboard

Generally correct rendered edge map but wrong edges extracted

Open peteryuan123 opened this issue 4 months ago • 0 comments

Hi! Thanks for the amazing work. I met some problems when try to train EMAP on a custom dataset. I provided 249 color images, their corresponding edge maps and a meta_data.json file. I suppose the "worldtogt" transformation in the meta file is just for evaluation, so I just set it as Identity. I also copy all the settings in DTU.conf to perform training.

After training, the rendered edge maps seems fairly good enough. The rendered edge map in validation process, after 195000 and 200000 iters. 00195000_20 00195000_20 The rendered depth map in validation process, after 195000 and 200000 iters. 00195000_20 00195000_20 The rendered normals in validation process, after 195000 and 200000 iters. 00195000_20 00195000_20

The last log states,

iter:200000 loss = 0.0443 edge_loss = 0.0435 eki_loss = 0.0797 eki_ns_loss = 0.2072 
iter:200000 variance = 0.009402 beta = 0.004565 gamma = 0.0396 lr_geo=0.00000500 lr=0.00002500 
psnr = 13.6153 weight_sum = 0.2400 weight_sum_fg_bg = 0.2400 udf_min = 0.04729267 udf_mean = 0.6288 igr_ns_weight = 0.0000 igr_weight = 0.0100 

However, after edge extraction, there are no points extracted. before visible checking: 0 after visible checking: 0

Then I try to play with the parameter in config file, I found increasing udf_threshold could increase the number of extracted points. I modify the udf_threshold from 0.015 to 0.05 but the extracted points are a mess. Screenshot from 2024-10-01 11-41-12

Could you help to solve the problem or tell me in which direction I can explore? Thank you very much!

peteryuan123 avatar Oct 01 '24 09:10 peteryuan123