second.pytorch icon indicating copy to clipboard operation
second.pytorch copied to clipboard

Why one-stage performs better?

Open shuluoshu opened this issue 6 years ago • 6 comments

Hi, @traveller59 ,Nice work! One question that I am confused is your recently updated "car.fhd.onestage.config", I notice that it just use one stage RPN instead of the original 2/3 stages. Except that I didn't find any other differences. So why does one-stage RPN even perform better than your original RPNV2? That's confusing, I cannot figure it out.

Thanks!

shuluoshu avatar Mar 01 '19 04:03 shuluoshu

This is speculative, but in 2D imagery, objects further from the sensor appear much smaller in the image, and so feature pyramids or differently-strided feature maps (1x, 2x, ..., 16x) can help provide a "multi-scale" representation. This may not be necessary in LIDAR since the 3D geometry is respected: objects further from the Velodyne sensor appear no smaller in the point cloud since there is no perspective projection. (Of course objects far away are still hard to detect since they are much more sparsely populated with LIDAR points).

jhultman avatar Mar 07 '19 16:03 jhultman

@jhultman ,Thx, so do you think multi-scale will do no help to improve the accuracy in LIDAR-based 3D detection?

shuluoshu avatar Mar 08 '19 07:03 shuluoshu

@shuluoshu I'm not sure--I would ask the author. The downsampling in the later stages yield an inflated receptive field which could make the feature maps more "context-aware." And if you're training a multiclass model on categories of very different sizes, you will encounter scale problems even though LIDAR is natively 3D.

jhultman avatar Mar 08 '19 20:03 jhultman

@jhultman when i python create_data.py create_kitti_info_file -data_path=/home/yzg/research/ljh/second/kittidata error occurred: File "/home/yzg/anaconda2/envs/py36/lib/python3.6/ctypes/init.py", line 348, in init self._handle = _dlopen(self._name, mode) OSError: /home/yzg/anaconda2/envs/py36/lib/python3.6/site-packages/spconv/libspconv.so: undefined symbol: _ZN3c106Symbol14fromQualStringERKSs

jihong111 avatar Mar 12 '19 07:03 jihong111

@jhultman when i python create_data.py create_kitti_info_file -data_path=/home/yzg/research/ljh/second/kittidata error occurred: File "/home/yzg/anaconda2/envs/py36/lib/python3.6/ctypes/init.py", line 348, in init self._handle = _dlopen(self._name, mode) OSError: /home/yzg/anaconda2/envs/py36/lib/python3.6/site-packages/spconv/libspconv.so: undefined symbol: _ZN3c106Symbol14fromQualStringERKSs

this error is probably because the environment changed, the environment you used now is not the environment you use to compile spconv ,remove spconv and rebuild it can solve the problem

vincezhai avatar Jan 13 '20 18:01 vincezhai

@jhultman when i python create_data.py create_kitti_info_file -data_path=/home/yzg/research/ljh/second/kittidata error occurred: File "/home/yzg/anaconda2/envs/py36/lib/python3.6/ctypes/init.py", line 348, in init self._handle = _dlopen(self._name, mode) OSError: /home/yzg/anaconda2/envs/py36/lib/python3.6/site-packages/spconv/libspconv.so: undefined symbol: _ZN3c106Symbol14fromQualStringERKSs

did u find a solution for this , I'm experiencing the same problem.

mohamedgamal7 avatar Jan 27 '21 11:01 mohamedgamal7