MixFormer icon indicating copy to clipboard operation
MixFormer copied to clipboard

Published 20 hours ago • verified publisher icon MCG-NJU

Stage 2 training

Open samueleruffino99 opened this issue 1 year ago • 7 comments

Hello! I would like to train stage 2 only, where can I find the pertained model for stage 1? Apparently on the drive there are online models only for convmae. Thank you!

samueleruffino99 avatar Nov 30 '23 22:11 samueleruffino99

Hi, there are all models of MixViT/MixViT(ConvMAE) and MixCvT on https://drive.google.com/drive/folders/1C0oECsbTB3uWk2MjrxDuVhIazcT975xb.

yutaocui avatar Dec 04 '23 03:12 yutaocui

But under MixViT-ConvMAE I can download online models only (already with SPM integrated).

samueleruffino99 avatar Dec 04 '23 07:12 samueleruffino99

You can just drop the SPM module since this module is trained on a separate stage with other weights getting detached.

yutaocui avatar Dec 05 '23 02:12 yutaocui

Ok, but then at stage 2 SPM only has been trained ? No more training on backbone and box head ?

samueleruffino99 avatar Dec 05 '23 08:12 samueleruffino99

Yes.

yutaocui avatar Dec 05 '23 08:12 yutaocui

But in this way the SPM would be already pretrained or everything is already implemented in the proper way?

samueleruffino99 avatar Dec 05 '23 09:12 samueleruffino99

We think finetuning the SPM module (excepting for backbone) is enough for filtering reliable samples.

yutaocui avatar Dec 06 '23 12:12 yutaocui