bevfusion icon indicating copy to clipboard operation
bevfusion copied to clipboard

nuscenes-mini Performance on TestSet Lower than the official results

Open wstzx opened this issue 2 years ago • 3 comments

Hello author, thank you so much for open sourcing your code. I tried to run your latest code using nuscenes-mini on a single GPU on 3090 and A5000, and it showed: 7.RuntimeError: Given groups=1, weight of size [8, 1, 1, 1], expected input[12, 6, 256, 704] to have 1 channels, but got 6 channels instead , so I setmmdet3d/models/vtransforms/base line37 and line38: False, but the results of the test MAP = 58, and after I used the two other old version to test, the result is only 58, far lower than the final result, is the reason I used one GPU?Here are the results of my single GPU tests in nuscenes-mini.This is my run command: torchpack dist-run -np 1 python tools/test.py configs/nuscenes/det/transfusion/secfpn/camera+lidar/swint_v0p075/convfuser.yaml pretrained/bevfusion-det.pth --eval bbox Uploading 1699876206693.png…

wstzx avatar Nov 14 '23 05:11 wstzx

The same problem. Do you have any new progress?

ZoeSnow avatar Nov 26 '23 07:11 ZoeSnow

The same problem.

qpc001 avatar Nov 29 '23 07:11 qpc001

We haven't used the mini dataset in our experiments. Have you tried the full dataset to see if the same issue still persists?

zhijian-liu avatar May 04 '24 02:05 zhijian-liu