Open-AnimateAnyone icon indicating copy to clipboard operation
Open-AnimateAnyone copied to clipboard

train 13000 step, texture is much different from reference image

Open VisionU opened this issue 1 year ago • 6 comments

In first stage, In oder to train model easy, we remove posenet, use VAE encoder instead(cat with noise like in-painting SD). Now it train 13000 step, texture is much different from reference image, is this correct? or we just need to waiting for more steps? image image

VisionU avatar Dec 28 '23 13:12 VisionU

I don't think it's normal... It looks scary.

guoqincode avatar Dec 28 '23 13:12 guoqincode

I will release the pre-trained model as soon as possible, please be patient, it may not take a few days.

guoqincode avatar Dec 28 '23 14:12 guoqincode

I will release the pre-trained model as soon as possible, please be patient, it may not take a few days. @guoqincode OK, I train it use 512x768, use r.clear(), w.clear(), can you give some advise for this bad result? data, or code?

VisionU avatar Dec 28 '23 14:12 VisionU

If it's a texture issue, I have two suggestions.

  1. Train more steps
  2. Check if unet is updated

guoqincode avatar Dec 28 '23 14:12 guoqincode

If it's a texture issue, I have two suggestions.

  1. Train more steps
  2. Check if unet is updated

Thank you ~

VisionU avatar Dec 28 '23 15:12 VisionU

Check if unet is updated Can you elaborate @guoqincode

sizhky avatar Dec 30 '23 18:12 sizhky

If it's a texture issue, I have two suggestions.

  1. Train more steps
  2. Check if unet is updated

Thank you ~

Can you fix it? If can, can you give some advices?

renrenzsbbb avatar Jan 30 '24 13:01 renrenzsbbb