Codes-for-PVKD icon indicating copy to clipboard operation
Codes-for-PVKD copied to clipboard

About mIOU score

Open liamlin5566 opened this issue 1 year ago • 1 comments

Hi, thank you for sharing this work. I want to know why the mIOU of Cylinder3D is 71.8, which is higher than original work in leaderboard. Do yo do any modification in training process?

liamlin5566 avatar Aug 09 '22 18:08 liamlin5566

We iteratively finetune the model with small learning rates. Instance augmentation is also adopted (Panoptic-PolarNet, CVPR 2021). You can have a try.

cardwing avatar Aug 11 '22 08:08 cardwing

Why do you use your own accounts to ask yourself questions?

lfl256 avatar Aug 16 '22 03:08 lfl256

Is there anything in this repository that is not fake?

The code is the same as Cylinder3D: https://github.com/cardwing/Codes-for-PVKD/issues/12 The pretrained weights can't be reproduced by anyone The so called "reproduced" results are very suspicious, and don't make any sense at all The stars are from paid bot/fake accounts: https://github.com/cardwing/Codes-for-PVKD/issues/15 The rankings are fake too: https://github.com/cardwing/Codes-for-PVKD/issues/11 Many issues are created by your own accounts

lfl256 avatar Aug 16 '22 03:08 lfl256

The pretrained weights can be reproduced by us on the A100 server. I have responded to most of the issues. I admit that the codes are very similar to the Cylinder3D codes since the distillation codes are not provided. The issues are created by other researchers and I just wonder what's your purpose on slandering us. @lfl256 I have gone through your github account and find that your activity is private. I wonder why you do this.

cardwing avatar Aug 19 '22 02:08 cardwing

It is strange that why you are so hostile to us. The codebase is still under construction and more modules will be added. @lfl256

cardwing avatar Aug 19 '22 02:08 cardwing

Here are the facts:

First of all, the pretrained weights CAN NOT be reproduced. There is no training code: https://github.com/cardwing/Codes-for-PVKD/issues/12, and you admit that.

You created many accounts on SemanticKITTI leaderboards: https://github.com/cardwing/Codes-for-PVKD/issues/19

You paid many bot accounts to get stars for this repo to mislead people and give the false impression about this repository.

And you admit that the ranking is misleading too: https://github.com/cardwing/Codes-for-PVKD/issues/11

lfl256 avatar Aug 19 '22 02:08 lfl256

I am just pointing out the facts

lfl256 avatar Aug 19 '22 02:08 lfl256

Please stop trying to fool others, everyone knows the truth. Because it is so obvious.

lfl256 avatar Aug 19 '22 02:08 lfl256

On the SemanticKITTI Multiple Scans benchmark: https://competitions.codalab.org/competitions/20331#results

You own these accounts: quanyyds: 2 submissions, 06/20/22 PVKD: 6 submissions, 12/10/21 PV-KD: 2 submissions, 12/01/21 PVD-KD: 4 submissions, 12/06/21 Point-Voxel-KD: 4 submissions, 11/26/21 Incredibai: 5 submissions, 07/12/22 liamlin543134: 5 submissions, 08/01/22

And many many more on other SemanticKITTI benchmarks.

According to the rules of SemanticKITTI https://competitions.codalab.org/competitions/20331#learn_the_details-terms_and_conditions

"Important note: It is NOT allowed to register multiple times to the server using different email addresses. We are actively monitoring submissions and we will revoke access and delete submissions."

lfl256 avatar Aug 19 '22 03:08 lfl256

First, "There is no training code" is obviously a fake comment. I provide the normal training code. The distillation codes are under preparation. Second, "You paid many bot accounts to get stars for this repo". We only recommend this repo to our friends and colleagues. How do you get the conclusion that I paid them? @lfl256

cardwing avatar Aug 19 '22 03:08 cardwing

First of all, the so called "normal training code" is from Cylinder3D, you didn't provide the training code to reproduce the "pretrained weights".

Running inference using the provided "pretrained weights" is not called "reproducing". "Reproducing" means training the model from scratch. You may have used all kinds of "tricks" to train these models.

lfl256 avatar Aug 19 '22 04:08 lfl256

@cardwing thanks for your response. And, @lfl256, my account is individual, not belonging to the author. The method I test is Cylinder3d (single scan) and use LMNet to distinguish moving object, so the score is similar to original Cylinder3d. Sorry for confusing you.

liamlin5566 avatar Aug 19 '22 10:08 liamlin5566