insightface icon indicating copy to clipboard operation
insightface copied to clipboard

Dataset about backbone

Open FengMu1995 opened this issue 2 years ago • 4 comments

I wonder why the backbone was trained with only one dataset every time. Why can't the backbone be trained with multiple dataset. As you upload "ResNet50@WebFace600K"

Looking forward to your reply

FengMu1995 avatar Mar 07 '22 08:03 FengMu1995

What do you mean by multiple datasets?

nttstar avatar Mar 20 '22 10:03 nttstar

Yes, the multiple datasets are combined into one big dataset which be used to train or the datasets are trained one by one.

FengMu1995 avatar Mar 22 '22 07:03 FengMu1995

I implemented this function in my code. Make each dataset into the form of mxnet style train.rec and train.idx. When accessing to each index, convert the global index to local index which can be applied to individual dataset. The big assumption is you do not have any overlapping in id between different datasets. It worked pretty well for me.

jacqueline-weng avatar Jun 14 '22 08:06 jacqueline-weng

I implemented this function in my code. Make each dataset into the form of mxnet style train.rec and train.idx. When accessing to each index, convert the global index to local index which can be applied to individual dataset. The big assumption is you do not have any overlapping in id between different datasets. It worked pretty well for me.

In this way, you don't have to rewrite training rec each time adding new data.

jacqueline-weng avatar Jun 14 '22 09:06 jacqueline-weng