faster_rcnn icon indicating copy to clipboard operation
faster_rcnn copied to clipboard

how to resume training faster-rcnn

Open Astrosun opened this issue 8 years ago • 6 comments

Hi, Is there a way to resume training faster-rcnn in the middle of the process? I think it will be good if we can resume the process like what caffe does just in case the computer loses power in the middle of the training.

Anyone can help? Thanks!

Astrosun avatar Sep 08 '16 09:09 Astrosun

@Astrosun Have you solved this pro yet? I also want to know :)

nyyznyyz1991 avatar Sep 26 '16 01:09 nyyznyyz1991

@nyyznyyz1991 I found that faster-rcnn has its own snapshot algorithm, which can enable you to resume your training.

Astrosun avatar Sep 26 '16 01:09 Astrosun

@Astrosun Can you give me some specific help?

jxgu1016 avatar Sep 27 '16 03:09 jxgu1016

@Drumaddheart, I did not look at too much details of the snapshot. But what I found is that if you terminate your program in the middle of the process, the program will at least resume the program from the last stage, for example, you just terminate your program in the middle of stage two detection training 20000k iterations, it will start at least from the stage two PRN training when your resume, but will start from 0 iterations.

Astrosun avatar Sep 27 '16 04:09 Astrosun

@Astrosun THX a lot. I have just found the situation you mentioned.

jxgu1016 avatar Sep 27 '16 08:09 jxgu1016

@nyyznyyz1991 I found that faster-rcnn has its own snapshot algorithm, which can enable you to resume your training.

brother post it here

punkkauz avatar Jun 02 '19 04:06 punkkauz