CLIP-ReID icon indicating copy to clipboard operation
CLIP-ReID copied to clipboard

Failure to replicate results?

Open Betricy opened this issue 1 year ago • 1 comments

Use the veri data set to train and evaluate. The results are as follows:

2023-10-24 21:53:58,401 transreid.test INFO: Validation Results 2023-10-24 21:53:58,402 transreid.test INFO: mAP: 75.5% 2023-10-24 21:53:58,402 transreid.test INFO: CMC curve, Rank-1 :92.0% 2023-10-24 21:53:58,402 transreid.test INFO: CMC curve, Rank-5 :94.4% 2023-10-24 21:53:58,402 transreid.test INFO: CMC curve, Rank-10 :95.9%

Rank_1 is 4.8% lower than in the paper...I double-checked the configs and ensured that the experiment settings were identical.

For reference, I'm attaching the training logs of the models:

train_log_cnn_prom_veri.txt

Betricy avatar Oct 24 '23 14:10 Betricy