cp-vton-plus icon indicating copy to clipboard operation
cp-vton-plus copied to clipboard

Training the GMM

Open tasinislam21 opened this issue 3 years ago • 4 comments

I wanted to train the GMM using the code you have provided but the screenshot below is the kind of result that I am getting:

Untitled

It does not warp the cloth at all after hours of training. What do I do?

tasinislam21 avatar Mar 04 '21 10:03 tasinislam21

Hi, @1702609 I'm facing this problem too. Have you solved this problem? Thanks a lot!

VVingerfly avatar Mar 15 '21 14:03 VVingerfly

Hello does the training ever finish? PS: I am new to AI, sorry if it's a stupid question.

traderdata avatar Mar 25 '21 13:03 traderdata

The current GMM training doesn't work properly because of correction of a mistake described in issue #50 . The authors made a mistake and wrote in paper that they train GMM by generating cloth mask but they were generating wrap cloth. Now code is compatible with paper but now it doesn't work. The solution is to uncomment line 93 in train.py and comment line 94.

edsuch21 avatar Apr 11 '21 22:04 edsuch21

Please change the line 94 as follows

pcm = inputs['parse_cloth_mask'].cuda() Lwarp = criterionL1(warped_mask, pcm).

I would recommend to change Lwarp = 3* criterionL1(warped_mask, pcm), as before the issue #50 the loss was criterionL1(warped_cloth, im_c) i.e. warped_cloth and im_c are both 3 channels while warped_mask and pcm have single channel. Multiplying it by 3 will put similar weight in the final "loss"

roy-sr avatar Jun 24 '21 08:06 roy-sr