OccNet icon indicating copy to clipboard operation
OccNet copied to clipboard

Question about the this baseline

Open zkyyyyyyy opened this issue 1 year ago • 6 comments

Hi, thanks to your great work.
I found the baseline code of this Challenge based on bevformer you provide does not have alignment operation between prev bev and current bev. In bevformer repository it is defined in "transformer.py". But in "transformerOcc.py" I do not find it. So can I ask why?

8ed535ae1a0db732e5235fac86233a2f

zkyyyyyyy avatar Apr 29 '24 14:04 zkyyyyyyy

Hello! The code in this repository builds upon last year's baseline, which deliberately omitted the temporal component of BEVFormer. It appears that the unresolved issue stems from BEVFormer's shift calculations being based on a y-forward coordinate system, while for the occupancy dataset, we utilize the nuScenes ego coordinate system, which is x-forward. Previous contributors likely did not have the time to make the necessary adjustments and opted to remove this feature for convenience.

sephyli avatar Apr 30 '24 01:04 sephyli

We have a fix about the coordinates issue at LaneSegNet repo. You can check it out here.

sephyli avatar Apr 30 '24 02:04 sephyli

We have a fix about the coordinates issue at LaneSegNet repo. You can check it out here.

I try to run this code but got no key named "can_bus" in the dict ['img_metas']. Then I go to check the anno .pkl file, actually no 'can_bus' information in it. Can you help me with this issue?

zkyyyyyyy avatar May 01 '24 07:05 zkyyyyyyy

The OpenOcc dataset doesn't construct a can_bus tensor. You can canstruct one or modify the code as you like.

sephyli avatar May 01 '24 09:05 sephyli

Here is a doc for can bus.

sephyli avatar May 01 '24 09:05 sephyli

The OpenOcc dataset doesn't construct a can_bus tensor. You can canstruct one or modify the code as you like.

So will the current baseline(pre_bev is None by default) perform worse than the case using and aligning pre_bev ?

Icecream-blue-sky avatar May 07 '24 14:05 Icecream-blue-sky