oneformer3d icon indicating copy to clipboard operation
oneformer3d copied to clipboard

Guidelines for handling unlabeled points

Open accoumar12 opened this issue 1 year ago • 6 comments

Hi, I first want to thank you for your amazing model, which we already successfully applied in CAD piece segmentation to retrieve the recto, verso and deburring of sheets metal. Here is some result of the segmentation of a single file. image Now we want to extend to other morphologies, such as detecting the holes in the pieces. However, we do not know how to handle gracefully the unlabeled data points for such point clouds. We first added a class called unlabeled, but the results are not satisfying... Do you recommend anything ? Be aware that most of our points are actually unlabeled so discarding them from the training would be really interesting.

Thanks for any help !

accoumar12 avatar Nov 26 '24 16:11 accoumar12

are you solving instance or semantic segmentation? for semantic segmentation you simply should not calculate loss for unlabeled points. for instance segmentation unlabeled points are also not a problem, as for example on scannet we consider walls and floors unlabeled for instance segmentation

filaPro avatar Nov 26 '24 18:11 filaPro

I am solving instance segmentation. How to translate the fact that a point is unlabeled ? Giving it an arbitrary label Index ?

accoumar12 avatar Nov 26 '24 19:11 accoumar12

Yes I think if your valid classes are 0, ... n_classes - 1, than given a n_classes label for a superpoint will result in ignoring it in instance segmentation.

filaPro avatar Dec 02 '24 09:12 filaPro

I am following the s3dis template configuration, and i get errors when using a smaller num_instance_classes than the num_semantic_classes.

accoumar12 avatar Dec 05 '24 11:12 accoumar12

For anyone interested, I found a solution to my problem. When using the S3Dis configuration, the PointInstClassMapping_ only takes as argument the num_instance_classes. So also -1 values are assigned to the max label, which makes torch one_hot function not working as expected !

accoumar12 avatar Dec 05 '24 14:12 accoumar12

So what was the solution? @accoumar12

ashutoshsingh0223 avatar May 15 '25 16:05 ashutoshsingh0223