Long-Range-Grouping-Transformer icon indicating copy to clipboard operation
Long-Range-Grouping-Transformer copied to clipboard

One question on F-Score

Open yesterday-Luo opened this issue 10 months ago • 5 comments

When I testing on ShapeNet dataset with F-score, I find it will waste too much time. A little help from you would be greatly appreciated!

yesterday-Luo avatar Mar 28 '24 12:03 yesterday-Luo

Hi, we test F-score based on open3d. It will waste time since it needs to sample points. For the computing details, please refer to Legoformer, we use similar methods except for a different open3d version.

LiyingCV avatar Mar 31 '24 00:03 LiyingCV

Thanks for your replying! And I have another question about "Evaluation on the Pix3D Dataset". Could you tell me some training details when you train on ShapeNet Chair dataset with random background from SUN database?

yesterday-Luo avatar Apr 05 '24 07:04 yesterday-Luo

Thanks for your replying! And I have another question about "Evaluation on the Pix3D Dataset". Could you tell me some training details when you train on ShapeNet Chair dataset with random background from SUN database?

Hi, the training configuration is similar to the experiments on ShapeNet except we only train a few epochs on ShapeNet Chair dataset.

LiyingCV avatar Apr 09 '24 01:04 LiyingCV

I’ve been referencing the Pix2Vox issue as well, but I’m still getting different results. Would it be possible for you to kindly share the full code for calculating the F1-score?

Thank you in advance for your help!

eolgaeng-i avatar Sep 04 '24 07:09 eolgaeng-i

I’ve been referencing the Pix2Vox issue as well, but I’m still getting different results. Would it be possible for you to kindly share the full code for calculating the F1-score?

Thank you in advance for your help!

Hi, the code we used is the same as Legoformer. We have tested the F-score of the pre-trained Pix2Vox++, unfortunately, we also obtained the F-Score which is different from Pix2Vox++ paper. Besides, we also find similar wrong results in the issue 76,. Thus we recommend directly using the test code of Legoformer.

LiyingCV avatar Sep 05 '24 01:09 LiyingCV

Hi, the code we used is the same as Legoformer. We have tested the F-score of the pre-trained Pix2Vox++, unfortunately, we also obtained the F-Score which is different from Pix2Vox++ paper. Besides, we also find similar wrong results in the issue 76,. Thus we recommend directly using the test code of Legoformer.

Hi, thank you so much for your prompt and kind response! I really appreciate the clarification and your suggestion to use the Legoformer test code. I will go ahead and follow your advice. Thanks again for your help, and I’m glad to say that the issue is now resolved!

eolgaeng-i avatar Oct 08 '24 10:10 eolgaeng-i

集上进行测试时,我发现这会浪

Hello, I am unable to measure the value in my paper using the F1 score code of LegoFormer. May I ask how you measured it

Tcode8 avatar Dec 13 '24 01:12 Tcode8

感谢您的回复!我还有一个关于“Pix3D 数据集评估”的问题。您能否告诉我在 ShapeNet Chair 数据集上使用来自 SUN 数据库的随机背景进行训练时的一些训练细节?

Hello, I am unable to measure the value in my paper using the F1 score code of LegoFormer. May I ask how you measured it

Tcode8 avatar Dec 13 '24 01:12 Tcode8

感谢您的回复!我还有一个关于“Pix3D 数据集评估”的问题。您能否告诉我在 ShapeNet Chair 数据集上使用来自 SUN 数据库的随机背景进行训练时的一些训练细节?

Hello, I am unable to measure the value in my paper using the F1 score code of LegoFormer. May I ask how you measured it

Hi, we will consider releasing the F1 score test code. Maybe it needs some time; it is necessary to clean the test code since we have not used this code for a long time :)

LiyingCV avatar Dec 13 '24 03:12 LiyingCV

感谢您的回复!我还有一个关于“Pix3D 数据集评估”的问题。您能否告诉我在 ShapeNet Chair 数据集上使用来自 SUN 数据库的后台随机进行训练时的一些细节训练?

您好,我无法使用 LegoFormer 的 F1 分数代码测量我的论文中的值。请问您是如何测量的

嗨,我们会考虑发布 F1 分数测试代码。可能需要一些时间;由于我们很久没有使用此代码了,因此有必要清理测试代码 :)

Thank you very much for your work!

Tcode8 avatar Dec 13 '24 03:12 Tcode8