denoise-imu-gyro icon indicating copy to clipboard operation
denoise-imu-gyro copied to clipboard

Different test results on TUM-VI datasets

Open Dynamite321 opened this issue 3 years ago • 8 comments

Hi,

I downloaded your pre-trained model on TUM-VI and evaluated it by the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation, which is also recommended by open-vins (https://docs.openvins.com/namespaceov__eval.html). The AOE results for rooms 2, 4, and 6 are 1.87, 1.44, and 1.93, respectively. However, the results provided by your paper are 1.31, 1.48, and 1.04. I wonder whether this is because of the existence of outliers in TUM-VI datasets and I need to remove them before I run the evaluation. Could you please give me any clue?

P.S. The evaluation results of EuRoC datasets with the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation are exactly the same as your paper.

Thanks!

Dynamite321 avatar Dec 11 '20 09:12 Dynamite321

Hi,

I downloaded your pre-trained model on TUM-VI and evaluated it by the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation, which is also recommended by open-vins (https://docs.openvins.com/namespaceov__eval.html). The AOE results for rooms 2, 4, and 6 are 1.87, 1.44, and 1.93, respectively. However, the results provided by your paper are 1.31, 1.48, and 1.04. I wonder whether this is because of the existence of outliers in TUM-VI datasets and I need to remove them before I run the evaluation. Could you please give me any clue?

P.S. The evaluation results of EuRoC datasets with the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation are exactly the same as your paper.

Thanks!

你好 请问你还有这个程序的优化参数和对应的数据集吗 感谢

RXvo avatar Mar 16 '22 12:03 RXvo

Hi,

I downloaded your pre-trained model on TUM-VI and evaluated it by the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation, which is also recommended by open-vins (https://docs.openvins.com/namespaceov__eval.html). The AOE results for rooms 2, 4, and 6 are 1.87, 1.44, and 1.93, respectively. However, the results provided by your paper are 1.31, 1.48, and 1.04. I wonder whether this is because of the existence of outliers in TUM-VI datasets and I need to remove them before I run the evaluation. Could you please give me any clue?

P.S. The evaluation results of EuRoC datasets with the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation are exactly the same as your paper.

Thanks! Hello, has your problem been solved? You can try using the evaluation tool provided by openvins!

successkaisadadi avatar May 02 '22 02:05 successkaisadadi

image

This is my results according to openVins, but I don't find AOE in result, and the result is not same as the AOE in paper. I also test it in https://github.com/uzh-rpg/rpg_trajectory_evaluation

huazai665 avatar Jun 20 '22 03:06 huazai665

image

This is my results according to openVins, but I don't find AOE in result, and the result is not same as the AOE in paper. I also test it in https://github.com/uzh-rpg/rpg_trajectory_evaluation

你好!你的数据集和优化参数现在还在嘛,可否给我发一份?[email protected]

scarLiu avatar Nov 22 '22 03:11 scarLiu

image This is my results according to openVins, but I don't find AOE in result, and the result is not same as the AOE in paper. I also test it in https://github.com/uzh-rpg/rpg_trajectory_evaluation

你好!你的数据集和优化参数现在还在嘛,可否给我发一份?[email protected]

do you get the dataset and parameters now? if you do , can you send one to me ? my email address is [email protected]! thank you !

dreamer1031 avatar Jul 24 '23 09:07 dreamer1031

Hi, I downloaded your pre-trained model on TUM-VI and evaluated it by the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation, which is also recommended by open-vins (https://docs.openvins.com/namespaceov__eval.html). The AOE results for rooms 2, 4, and 6 are 1.87, 1.44, and 1.93, respectively. However, the results provided by your paper are 1.31, 1.48, and 1.04. I wonder whether this is because of the existence of outliers in TUM-VI datasets and I need to remove them before I run the evaluation. Could you please give me any clue? P.S. The evaluation results of EuRoC datasets with the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation are exactly the same as your paper. Thanks!

你好 请问你还有这个程序的优化参数和对应的数据集吗 感谢

Hello, do you still have the corresponding optimization parameters and data set of this code? The author's links have all failed. Thank you!

alun9258 avatar Mar 25 '24 01:03 alun9258

image This is my results according to openVins, but I don't find AOE in result, and the result is not same as the AOE in paper. I also test it in https://github.com/uzh-rpg/rpg_trajectory_evaluation

你好!你的数据集和优化参数现在还在嘛,可否给我发一份?[email protected]

Hello, do you still have the corresponding optimization parameters and data set of this code? The author's links have all failed. Thank you![email protected]

alun9258 avatar Mar 25 '24 01:03 alun9258

image This is my results according to openVins, but I don't find AOE in result, and the result is not same as the AOE in paper. I also test it in https://github.com/uzh-rpg/rpg_trajectory_evaluation

你好!你的数据集和优化参数现在还在嘛,可否给我发一份?[email protected]

do you get the dataset and parameters now? if you do , can you send one to me ? my email address is [email protected]! thank you !

Hello, do you still have the corresponding optimization parameters and data set of this code? The author's links have all failed. Thank you![email protected]

alun9258 avatar Mar 25 '24 01:03 alun9258