StyleDrop-PyTorch icon indicating copy to clipboard operation
StyleDrop-PyTorch copied to clipboard

About general ability

Open lucasjinreal opened this issue 2 years ago • 7 comments

image image

lucasjinreal avatar Jul 07 '23 05:07 lucasjinreal

Hi, thanks for your interest.

We want to clarify that this is an inference-only demo, that only supports our trained styles (denoted as 102, 103, 106, .etc, and the corresponding style images are presented in the examples). As can be seen, the selected style is None, which means this is an inference with the vanilla MUSE-Pytorch model, without our trained StyleDrop. We will update the gradio demo to better clarify its usage.

The gradio demo does not yet support training & inference with custom images, but you can still refer to the instructions here in our readme to train your custom StyleDrop weight.

Welcome further feedback on training your custom StyleDrop weights!

encounter1997 avatar Jul 07 '23 06:07 encounter1997

@encounter1997 I see. When will a training support at least on my local machine?

lucasjinreal avatar Jul 07 '23 07:07 lucasjinreal

Could you provide information about the specifications of your local machine? Our code has been tested on Ubuntu 22.04 with a GPU that has 24GB of memory.

encounter1997 avatar Jul 07 '23 08:07 encounter1997

@encounter1997 Will 16GB mem work?

lucasjinreal avatar Jul 07 '23 12:07 lucasjinreal

how long it trains on 3090 , whats the max resolution?

2blackbar avatar Jul 07 '23 21:07 2blackbar

how long it trains on 3090 , whats the max resolution?

If you set config.sample_interval = False here, 10 minutes enough, the max resolution is 256x256

zideliu avatar Jul 08 '23 03:07 zideliu

@encounter1997 Will 16GB mem work?

Not very clear, u can use fp16 clip by set prompt_model,_,_ = open_clip.create_model_and_transforms('ViT-bigG-14', 'laion2b_s39b_b160k',device='cpu') here. Have a try

zideliu avatar Jul 08 '23 03:07 zideliu