Voxel-MAE icon indicating copy to clipboard operation
Voxel-MAE copied to clipboard

Masking Implementation

Open YilmazKadir opened this issue 2 years ago • 5 comments

In the paper, you say that you mask the point cloud similar to MAE but I could not find the details. In MAE image is divided into patches that contain 14x14 pixels and then randomly masked at patch level. Do you also divide the scenes into 14x14x14 voxels similarly, or do you just randomly select 50% of voxels in each scene and mask them?

YilmazKadir avatar Jul 22 '22 15:07 YilmazKadir

just randomly select 50% of voxels in each scene and mask them

We just randomly select 50% of voxels in each scene and mask them. The pathes in MAE are similar to the voxels in our Voxel-MAE.

chaytonmin avatar Jul 23 '22 03:07 chaytonmin

The paper indicates that mask ratio varies with distance, but I can't find the related code.Can you please tell me where it is,or you just set the mask ratio to 50% in spite of distance?

alpacaduby avatar Jan 28 '23 07:01 alpacaduby

The paper indicates that mask ratio varies with distance, but I can't find the related code.Can you please tell me where it is,or you just set the mask ratio to 50% in spite of distance?

Please refer to:

https://github.com/chaytonmin/Voxel-MAE/blob/459fafc67300a63a345edeb4701cd2adf24e4838/tools/cfgs/kitti_models/voxel_mae_kitti.yaml#L15

https://github.com/chaytonmin/Voxel-MAE/blob/459fafc67300a63a345edeb4701cd2adf24e4838/pcdet/models/backbones_3d/voxel_mae.py#L157

chaytonmin avatar Jan 28 '23 07:01 chaytonmin

But then you mask 50% (0-30) and 30% for (30-inf). In the paper, you claim "For voxels within 0-30 meters, 30-50 meters, and > 50 meters, we set the masking ratio to 90%, 70%, and 50%, respectively."

YilmazKadir avatar Jan 30 '23 13:01 YilmazKadir

Voxel-MAE/tools/cfgs/kitti_models/voxel_mae_kitti.yaml

You can set the masking ratio to 90% in https://github.com/chaytonmin/Voxel-MAE/blob/459fafc67300a63a345edeb4701cd2adf24e4838/tools/cfgs/kitti_models/voxel_mae_kitti.yaml#L15

chaytonmin avatar Feb 10 '23 06:02 chaytonmin