magvit2-pytorch icon indicating copy to clipboard operation
magvit2-pytorch copied to clipboard

Pixelated image reconstruction

Open coolbunnyx opened this issue 1 year ago • 7 comments

Trained the model on a set of 10K images (randomly cropped 128 x 128 patches) for 6K iteration with a batch size of 8. The output looks pixelated. Is this what is expected, or the output should somehow look similar to the input? Any feedbacks are appreciated!

2024-01-07_19-45-46

coolbunnyx avatar Jan 08 '24 00:01 coolbunnyx

@coolbunnyx is there any chance you could share the script you used to train this?

BenicioEnriquez avatar Jan 15 '24 17:01 BenicioEnriquez

meeting the same problem,Have you solved this problem? @coolbunnyx

syyxsxx avatar Jan 22 '24 15:01 syyxsxx

meeting the same problem,Have you solved this problem? @coolbunnyx

I've given it up; not sure if the issue is the code or just me lacking the computing resources to make it converge quickly to the right solution. Intuitively, it should converge to something similar to the input image instead of getting pixelated, though I might be wrong.

coolbunnyx avatar Jan 24 '24 16:01 coolbunnyx

@lucidrains do you have any comment, I am facing the same issue

Borhanv-nd avatar Feb 09 '24 22:02 Borhanv-nd

Trained the model on a set of 10K images (randomly cropped 128 x 128 patches) for 6K iteration with a batch size of 8. The output looks pixelated. Is this what is expected, or the output should somehow look similar to the input? Any feedbacks are appreciated!

2024-01-07_19-45-46

Could you please share your config for training? I just cannot reproduce anything except the black blocks. Many thanks!

canqin001 avatar Feb 24 '24 05:02 canqin001

Trained the model on a set of 10K images (randomly cropped 128 x 128 patches) for 6K iteration with a batch size of 8. The output looks pixelated. Is this what is expected, or the output should somehow look similar to the input? Any feedbacks are appreciated! 2024-01-07_19-45-46

Could you please share your config for training? I just cannot reproduce anything except the black blocks. Many thanks!

It may work if you turn off the use_gan.

Jason3900 avatar Mar 07 '24 02:03 Jason3900

@lucidrains @Borhanv-nd I'm running into the same situation, do you have any comments on this issue? Do I need to train more steps?

void-main avatar Mar 29 '24 00:03 void-main