VPGNet icon indicating copy to clipboard operation
VPGNet copied to clipboard

Hi, I have some problem with your post process for the lane detection.

Open weitaoatvison opened this issue 8 years ago • 14 comments

Hi, I found in your paper you declared your algorithm speed could achieve to 20Fps, so I am confused whether the speed you declared is just the speed of the network inference time or with the post process included clustering and curve fitting? If it is with the post-process, could you share your post process code? Thanks for your good job!

weitaoatvison avatar Dec 21 '17 03:12 weitaoatvison

@weitaoatvison Hi, the algorithm speed, 20fps, includes both forward-pass and post-processing time. Specifically, the single forward pass takes about 30ms (on single Titan X) and the post-processing takes about 20ms or less. For the post-processing code, we need to get an additional permission from Samsung Research.. (T_T) I recommend you to re-implement it following our post-processing part (except VP) because it covers only a few lines.

SeokjuLee avatar Dec 21 '17 06:12 SeokjuLee

OK, Thanks for your reply. I have done a simillar work but the post-processing time is too large, so I am interested in your post-processing code. HaHa~

weitaoatvison avatar Dec 21 '17 07:12 weitaoatvison

@weitaoatvison Here are some helpful libraries and functions, which are fast. Please refer them. Lane-seed-sampling: https://github.com/MonsieurV/py-findpeaks IPM: https://docs.opencv.org/2.4/modules/core/doc/operations_on_arrays.html#perspectivetransform

SeokjuLee avatar Dec 21 '17 13:12 SeokjuLee

@SeokjuLee Thanks very much! In our implementation, we use an IPM we implement by our-self. And I am wonder that how to use https://github.com/MonsieurV/py-findpeaks to do lane-seed-sampling? I find this code is used to do peak detection.

weitaoatvison avatar Dec 25 '17 09:12 weitaoatvison

@weitaoatvison It's for the lane clustering (visualization). This enables to subsample peak points from the probability map. Please refer our paper (related section 4.4)

SeokjuLee avatar Dec 26 '17 07:12 SeokjuLee

@SeokjuLee Thanks! I will check the paper again!

weitaoatvison avatar Dec 27 '17 02:12 weitaoatvison

Hi. Where can I find explanation about the structure of the multi-classification task output. I understand that 80x60 part is the input image size divided by 8, but what is the 64 part?

ArtyomKa avatar Dec 28 '17 08:12 ArtyomKa

@ArtyomKa That part assigns the number of types. The number of channel 64 for the multi-label task includes auxiliary classes.

SeokjuLee avatar Dec 28 '17 12:12 SeokjuLee

@SeokjuLee Thanks.. In the paper (Table 2) there are only about 20 classes listed. There are additional 44 aux. classes? The first 20 are the ones that are in the table, or am i missing something..

ArtyomKa avatar Dec 28 '17 12:12 ArtyomKa

@ArtyomKa Yes, there is no problem if it is set to be larger than the number of classes to be detected. In my work there are 17 classes, and empty gradient from the rest 47 (=64-17) channels. The remaining 47 classes are regarded as meaningless classes

SeokjuLee avatar Dec 28 '17 12:12 SeokjuLee

@SeokjuLee OK, makes sense! Thank You!

ArtyomKa avatar Dec 28 '17 12:12 ArtyomKa

@SeokjuLee I have a question about the detection of lane. Different from the road marking, the lane is thin and long. According to Figure 3 in your paper, the size of grid box is 120x160x4 and there are 120x160 bound boxes. I want to know whether the bounding box of label cover the entire lane or just cover a part of entire lane.

chengm15 avatar Jan 02 '18 13:01 chengm15

@chengm15 The bounding box of label covers just a part of a lane. By generating grids to train them, we did not have to consider the various scales.

SeokjuLee avatar Jan 02 '18 13:01 SeokjuLee

@SeokjuLee Hi, what are the indexes of the 17 meaningful channels in the 64 channel output of multi-label task? Are they the first 1~17 channels, one to one corresponding to your Table 2? I have output the pobabilies, most grid are belonging to the firs class, so I suppose the first channel should be some background class? or am I wrong?

HuifangZJU avatar Jan 07 '18 09:01 HuifangZJU