mprm icon indicating copy to clipboard operation
mprm copied to clipboard

Questions about 6.2. pseudo label evaluation

Open ruler9527 opened this issue 4 years ago • 0 comments

I have a question about how the pseudo labels on validation sets in Table 3 evaluated in code? I observed that the validation data in the scannet_subcloud.py is 1201 training data, and through generate_pseudo_label.py, it is possible to generate and evaluate 1201 pseudo labels of Training (i.e., Training in Table 3). I would like to know what comments or statements to add if I want to get the validation set evaluation? In scannet_subcloud.py, I try to comment out the following lines of code:(line 414~418) # Get number of clouds self.input_trees['validation'] = self.input_trees['training'] self.input_colors['validation'] = self.input_colors['training'] self.input_vert_inds['validation'] = self.input_colors['training'] self.input_labels['validation'] = self.input_labels['training'] I also change the following code (line 447,remove the "not"): if (not self.load_test) and 'train' in cloud_folder and cloud_name not in self.validation_clouds: In addition, in generate_pseudo_label.py, I change the validation_size=312. After making these changes, an error occurs when running the generate_pseudo_label.py, as follows: Traceback (most recent call last): File "generate_pseudo_label.py", line 183, in test_caller(chosen_log, chosen_snapshot, on_val) File "generate_pseudo_label.py", line 131, in test_caller tester.test_cloud_segmentation_on_val(model, dataset) File "/home/chn/Downloads/Weakly Supervised/mprm-master/utils/tester_cam.py", line 543, in test_cloud_segmentation_on_val probs = self.test_probs[i_val][dataset.validation_proj[i_val], :] IndexError: list index out of range

ruler9527 avatar Oct 10 '20 13:10 ruler9527