stereo-transformer icon indicating copy to clipboard operation
stereo-transformer copied to clipboard

Questions about the evaluation results of Kitti (2015)

Open cp319 opened this issue 3 years ago • 4 comments

The following figure shows the expected results obtained by using the 'kitti_finetuned_model.pth.tar' image However, I can not get the evaluation results in the following table. image Note that I haven't made any fine adjustments to the model.

cp319 avatar Aug 29 '22 10:08 cp319

This is a very good job. However, the above problems may be caused by some unknown problems. Thank you.

cp319 avatar Aug 29 '22 10:08 cp319

Hi @cp319

Thank you for your interest in the project. I am not able to reproduce your error. Maybe you have something off during your evaluation? Please see the result I just ran today. I have also attached the log file for your reference.

image epoch_0.log

mli0603 avatar Sep 04 '22 20:09 mli0603

Hi @cp319

Thank you for your interest in the project. I am not able to reproduce your error. Maybe you have something off during your evaluation? Please see the result I just ran today. I have also attached the log file for your reference.

image epoch_0.log

Thank you very much for your reply, but I doubt whether you used the model 'kitti_finetuned_model.pth.tar' you released for evaluation.

cp319 avatar Sep 05 '22 06:09 cp319

@cp319

Yes. I am using the same file.

Here is the set of arguments I used for your reference.

--epochs
1
--batch_size
1
--dataset
kitti2015
--dataset_directory
/data/Data/KITTI/2015
--checkpoint
inference
--num_workers
2
--eval
--validation
validation_all
--apex
--resume
YOUR_PATH_TO_PRETRAINED_MODEL

mli0603 avatar Sep 05 '22 15:09 mli0603