ControlNet-v1-1-nightly icon indicating copy to clipboard operation
ControlNet-v1-1-nightly copied to clipboard

Published 20 hours ago • verified publisher icon lllyasviel

Tile model training details

Open nikitabalabin opened this issue 1 year ago • 6 comments

Could you please provide details on what data you used to train a tile model. Were it crops from big images? Did you use down-up resampling? And some other information.

nikitabalabin avatar May 18 '23 22:05 nikitabalabin

I also have really big curiousity about how to train tiling model. is it similar to IF method? there are, I think, other different upscaling methods for getting clear, sharpt high resolution images like IF, SD x4 upscaler, SDXL 0.9(1.0 soon). I tried to img2img on SD x4 upscaler and Controlnet tile model and I think your model wins. what is the difference? how to prepare dataset for retraining? should I have 4K image and reduce the size and apply several blurring? that's all? then Controlnet will output bigger sized images while training?

dedoogong avatar Jul 13 '23 03:07 dedoogong

@dedoogong what is IF method?

onion-liu avatar Jul 13 '23 03:07 onion-liu

@dedoogong what is IF method?

DeepFloyd IF (Imagen)

yuangpeng avatar Aug 15 '23 16:08 yuangpeng

Any new information about this topic?

whlp-synth avatar Oct 13 '23 11:10 whlp-synth

also see #125

geroldmeisinger avatar Oct 13 '23 17:10 geroldmeisinger

In case anyone is still interested, I got controlnet tile training working, and the script is uploaded here https://github.com/zjysteven/controlnet_tile. test_screenshot

zjysteven avatar May 02 '24 21:05 zjysteven