InSPyReNet icon indicating copy to clipboard operation
InSPyReNet copied to clipboard

Fine tuning

Open rishabh063 opened this issue 1 year ago • 11 comments

Hey I have been fine tuning using pre-trained checkpoint . however Having issues for it to converge , I have 20k Mask and image set for background removal . I have run 30 Epochs and the results are worse than the pretrained one

Any advice on how many epoch or learning rate ?

rishabh063 avatar Jan 25 '24 09:01 rishabh063

Finetuning with additional data only may cause catastrophic forgetting. Try adding your data to the composite dataset.

plemeri avatar Jan 29 '24 04:01 plemeri

Finetuning with additional data only may cause catastrophic forgetting. Try adding your data to the composite dataset.

I'm just curious - what's the reason of that?

LukaGiorgadze avatar Jan 29 '24 07:01 LukaGiorgadze

So you mean i Need to train on the pretraining dataset and my own dataset ? Can this be an issue with my dataset?

rishabh063 avatar Jan 29 '24 21:01 rishabh063

@plemeri I saw that in your transparent background libraries nightly model scores much higher than HR model in model zoo when tested on DUTS-TE . Can you share the reason and training technique ? is it just trained longer ?

rishabh063 avatar Feb 25 '24 14:02 rishabh063

Nightly model was trained with the updated training strategy which was my doctorate dissertation. Currently I have no time to release updated contents.

plemeri avatar Feb 26 '24 02:02 plemeri

can you share that dissertation document ? i can update the code

rishabh063 avatar Feb 27 '24 10:02 rishabh063

@plemeri if you can share it

rishabh063 avatar Mar 01 '24 04:03 rishabh063

My dissertation is not publicly opened yet because of the ongoing patent registration. Sorry for that.

plemeri avatar Mar 04 '24 02:03 plemeri

@plemeri congrats on your doctorate dissertation! 👍 I would be more than happy to see the updates on this repository and not kill as everyone does after some time. We are waiting updated training strategy at some point.

LukaGiorgadze avatar Mar 07 '24 18:03 LukaGiorgadze

Hello all, just for the heads up, the patent office just started to apply the patent to the US. However, I'm afraid there are better methods out there since our work has been released, so it would be better using their work but I'll release the updates as soon as the patent process finishes. Until then!

plemeri avatar Aug 23 '24 09:08 plemeri

Could you point us in the direction of these better methods then? :)

MHillier98 avatar Aug 25 '24 15:08 MHillier98