tdanet icon indicating copy to clipboard operation
tdanet copied to clipboard

Model generalization ability?

Open yuchen-ji opened this issue 1 year ago • 2 comments

Can the model in this article be generalized on images outside the dataset, such as completing a masked chair image?

yuchen-ji avatar Mar 20 '23 14:03 yuchen-ji

It can not. The provided weights are trained on a limited small dataset. But the method could be used for open-domain data. For example, you can replace the image encoder with CLIP and train it on a large image-text dataset. Besides, existing diffusion models like GLIDE and StableDiffusion provide better paint ability. If your machine can not run a diffusion model, you may use this TDANet network.

idealwhite avatar Mar 20 '23 14:03 idealwhite

I see. Thank you very much for your work and suggestions!

yuchen-ji avatar Mar 20 '23 14:03 yuchen-ji