UniAD icon indicating copy to clipboard operation
UniAD copied to clipboard

About IDS indicators

Open haichen-ber opened this issue 1 year ago • 2 comments

Thanks to the author for the proposed method. I found 'nan' in some categories of IDS indicators during eval. What does this mean? "ids": { "bicycle": NaN, "bus": NaN, "car": 285.0, "motorcycle": NaN, "pedestrian": NaN, "trailer": NaN, "truck": NaN } Looking forward to your guidance.

haichen-ber avatar Aug 04 '23 02:08 haichen-ber

@haichen-ber Hi, does these values come from evaluation? Could you please specify this problem a little bit? Any log information or screenshot would be helpful.

YTEP-ZHI avatar Aug 04 '23 06:08 YTEP-ZHI

@haichen-ber Hi, does these values come from evaluation? Could you please specify this problem a little bit? Any log information or screenshot would be helpful.

This evaluation is my own use of some corruption methods of imagenet-c to test the performance of UniAD. If this happens to IDS, does it mean that the identity cannot be determined?

haichen-ber avatar Aug 04 '23 06:08 haichen-ber