Unable to reproduce the paper results

[memoiry]

Hi,

I'm currently trying to reproduce the results from a paper, but I've noticed some discrepancies with the paper's results.

For COCO:

CUDA_VISIBLE_DEVICES=0,1,2,3 vit=l task=ovd dataset=coco bash scripts/train.sh

[10/29 09:19:44 d2.evaluation.coco_evaluation]: target AP50: 0.4874418084766285
[10/29 09:19:44 d2.evaluation.coco_evaluation]: base AP50: 0.5425877731149755
[10/29 09:19:44 d2.evaluation.coco_evaluation]: all AP50: 0.5281649823634078

In this result, the "target AP" is only 0.487, which is not matching the paper's value of 50.0.

For LVIS:

CUDA_VISIBLE_DEVICES=4,5,6,7 vit=l task=ovd dataset=lvis bash scripts/train.sh

[10/30 05:21:34 d2.evaluation.lvis_evaluation]: Evaluation results for bbox:
|   AP   |  AP50  |  AP75  |  APs   |  APm   |  APl   |  APr   |  APc   |  APf   |
|:------:|:------:|:------:|:------:|:------:|:------:|:------:|:------:|:------:|
| 30.528 | 46.628 | 32.179 | 20.129 | 39.120 | 44.962 | 32.268 | 29.912 | 30.450 |

Here, the "APr" is only 32.2680, which does not match the paper's value of 34.3.

I used 4 GPUs for training purpose. Can you please help me identify what might be causing these discrepancies? Thank you.

Best,