MapTR icon indicating copy to clipboard operation
MapTR copied to clipboard

original dataset overlap problem

Open wheelandwheat opened this issue 11 months ago • 1 comments

Hello, author,

In the maptr_V2 paper, the central line exhibited excellent results. Did you split the dataset because the training and testing sets of the original dataset overlap geographically(both nuscense and argoverse)? We reproduced your paper lanegap and tested splitting dataset by location. The results on the original, non-split dataset were indeed impressive. However, after splitting based on geographic location, the performance declined. This was evident in both accuracy and recall. It seems that the model may have overfit the non-split dataset.

wheelandwheat avatar Sep 18 '23 07:09 wheelandwheat