SOLOFusion icon indicating copy to clipboard operation
SOLOFusion copied to clipboard

Published 20 hours ago • verified publisher icon Divadi

Performance mismatch

Open Yzichen opened this issue 1 year ago • 2 comments

I use bs=4x8, lr=1e-4 for training and the cbgs result is:

Evaluating bboxes of pts_bbox mAP: 0.4166 mATE: 0.5791 mASE: 0.2850 mAOE: 0.5265 mAVE: 0.2424 mAAE: 0.1887 NDS: 0.5261 Eval time: 72.3s

Yzichen avatar Feb 03 '24 23:02 Yzichen

Hmm.. I have not validated lower batch size. Prior work have shown that with lower batch size, performance may decline a bit. Perhaps you can consider tuning the learning rate a bit - I will leave this issue open so others can comment if they face similar issues.

Divadi avatar Mar 07 '24 15:03 Divadi

I also have the same issues. When I use a batch size of 32, the performance will drop about 1 pp both on NDS and mAP.

Mingqj avatar Sep 25 '24 02:09 Mingqj