progrockdiffusion icon indicating copy to clipboard operation
progrockdiffusion copied to clipboard

what's possible with DD, some amazing artwork

Open nikocraft opened this issue 3 years ago • 11 comments

No issue this time, I just thought I'd show some "Ruins of Cthulhu temple in Antartica" and how good DD really is for concept art.

Antartica_17_2 Antartica_17_5 Antartica_10_2 Antartica_11_0 Chuthlu_10_0

Antartica_12_0 Antartica_12_9 Antartica_12_11 Chuthlu_10_1

Antartica_12_18 Antartica_12_19 Antartica_13_1 Antartica_13_9 Chuthlu_10_2

Antartica_13_10 Chuthlu_16_1 Chuthlu_29_0 Chuthlu_1_3

nikocraft avatar Jun 29 '22 08:06 nikocraft

Incredible, these are the best images I've seen with disco diffusion. The composition, and consistency are very close to an illustrator's work.

hydropix avatar Jun 29 '22 10:06 hydropix

Fantastic stuff!

Here's a few I've recently made: bigsur_28_0 bigsur_24_0 spynovel_48_0 fantasy_298_0 fantasy_275_0

lowfuel avatar Jun 29 '22 12:06 lowfuel

This one ! gorgeous ! https://user-images.githubusercontent.com/18050333/176439052-9fe3c56d-789e-4140-9e7e-02385fa987c2.png

hydropix avatar Jun 29 '22 13:06 hydropix

Few more of Chuthlu him self in person, attacking ships, consuming ships, commanding pirate ships and so on...

Chuthlu_2_11 Chuthlu_3_0 Chuthlu_1_5 Chuthlu_2_1 Chuthlu_2_2 Chuthlu_2_5 Chuthlu_2_6 Chuthlu_2_7 Chuthlu_2_9

nikocraft avatar Jun 29 '22 13:06 nikocraft

Mind sharing your settings? These look amazing!

dblunk88 avatar Jun 29 '22 14:06 dblunk88

Mind sharing your settings? These look amazing!

{
  "batch_name": "Chuthlu",
  "text_prompts": {
    "0": [
      "Ruins of Cthulhu temple in Antartica at dawn, gold hour, big sea waves hitting shore, Large Cthulhu figure in background, dramatic lighting, cinematic, detailed, by your_favorite_artist, trending on Artstation."
    ]
  },
  "n_batches": 50,
  "steps": 200,
  "display_rate": 10,
  "width": 1200,
  "height": 800,
  "diffusion_model": "512x512_diffusion_uncond_finetune_008100",
  "ViTB32": 1.0,
  "ViTB16": 1.0,
  "ViTL14": false,
  "ViTL14_336": 1.0,
  "RN101": false,
  "RN50": false,
  "RN50x4": false,
  "RN50x16": false,
  "RN50x64": false,
}

your_favorite_artist = try to find concept artists, not realistic artists, DD is really good then at coherent images and concept art of world class :)

give it a spin, let me know how it goes for you. Use different prompt since I've already got over 200 works of Chutlu Ive seen it all :D

nikocraft avatar Jun 29 '22 14:06 nikocraft

Chuthlu_10_0 Chuthlu_10_1 Chuthlu_11_1

nikocraft avatar Jun 29 '22 14:06 nikocraft

Great works. The parameters are present in the metadata of the png, and it is very useful! But you shouldn't say too much about it. It's cool to share the parameters! We need to progress all together. thanks

hydropix avatar Jun 29 '22 15:06 hydropix

Mind sharing your settings? These look amazing!

{
  "batch_name": "Chuthlu",
  "text_prompts": {
    "0": [
      "Ruins of Cthulhu temple in Antartica at dawn, gold hour, big sea waves hitting shore, Large Cthulhu figure in background, dramatic lighting, cinematic, detailed, by your_favorite_artist, trending on Artstation."
    ]
  },
  "n_batches": 50,
  "steps": 200,
  "display_rate": 10,
  "width": 1200,
  "height": 800,
  "set_seed": "random_seed",
  "image_prompts": {},
  "clip_guidance_scale": 11000,
  "tv_scale": 0,
  "range_scale": 150,
  "sat_scale": 0,
  "cutn_batches": 2,
  "init_image": null,
  "skip_steps_ratio": 0.33,
  "init_scale": 1000,
  "skip_steps": 0,
  "perlin_init": false,
  "perlin_mode": "mixed",
  "skip_augs": false,
  "randomize_class": true,
  "clip_denoised": false,
  "clamp_grad": true,
  "clamp_max": 0.05,
  "fuzzy_prompt": false,
  "rand_mag": 0.05,
  "eta": 0.8,
  "diffusion_model": "512x512_diffusion_uncond_finetune_008100",
  "use_secondary_model": true,
  "sampling_mode": "ddim",
  "ViTB32": 1.0,
  "ViTB16": 1.0,
  "ViTL14": false,
  "ViTL14_336": 1.0,
  "RN101": false,
  "RN50": false,
  "RN50x4": false,
  "RN50x16": false,
  "RN50x64": false,
  "cut_overview": "[5]*400+[1]*600",
  "cut_innercut": "[1]*400+[5]*600",
  "cut_ic_pow": "[1]*800+[6]*200",
  "cut_ic_pow_final": null,
  "cut_icgray_p": "[0.2]*400+[0]*600",
  "smooth_schedules": false,
  "intermediate_saves": 20,
  "stop_early": 0,
  "fix_brightness_contrast": true,
  "high_contrast_threshold": 80,
  "high_contrast_adjust_amount": 0.85,
  "high_contrast_start": 20,
  "high_contrast_adjust": true,
  "low_contrast_threshold": 20,
  "low_contrast_adjust_amount": 2,
  "low_contrast_start": 20,
  "low_contrast_adjust": true,
  "high_brightness_threshold": 180,
  "high_brightness_adjust_amount": 0.85,
  "high_brightness_start": 0,
  "high_brightness_adjust": true,
  "low_brightness_threshold": 40,
  "low_brightness_adjust_amount": 1.15,
  "low_brightness_start": 0,
  "low_brightness_adjust": true,
  "gobig_orientation": "vertical",
  "gobig_scale": 2,
  "keep_unsharp": false,
  "symmetry_loss_v": false,
  "symmetry_loss_h": false,
  "symm_loss_scale": 2400,
  "symm_switch": 45,
  "interp_spline": "Linear",
  "max_frames": 1000,
  "sharpen_preset": "Off",
  "frames_scale": 1500,
  "frames_skip_steps": "60%",
  "animation_mode": "None",
  "key_frames": true,
  "angle": "0:(0)",
  "zoom": "0: (1), 10: (1.05)",
  "translation_x": "0: (0)",
  "translation_y": "0: (0)",
  "video_init_path": "/content/training.mp4",
  "extract_nth_frame": 2
}

your_favorite_artist = try to find concept artists, not realistic artists, DD is really good then at coherent images and concept art of world class :)

give it a spin, let me know how it goes for you. Use different prompt since I've already got over 200 works of Chutlu Ive seen it all :D

Much appreciated! What GPU are you running? Personally just upgraded to a 3090 TI for the VRAM increase. If you're running anything similar (seeing the VITL 336 :) ), I'd look at the Memory usage and if you can fit in a bit more, I'd up the cuts

dblunk88 avatar Jun 29 '22 15:06 dblunk88

ahh that VITL336 is just my latest experiment, I actually produced most of pics without it, it give more realistic pics is that someone recommended me on DD Discord. I got 3090 with 24 GB, so far I've had no issues with anything I've tried, 3090 bravely handles it all.

With concept art style that you are seeing above this is true "less is more", so less cuts is better otherwise it starts looking like something else. With concept art you provide just enough details and let the human brain imagine the rest :D Important things become the mood, the lightning, etc which DD excells as with right propmpt and right models&settings.

nikocraft avatar Jun 29 '22 15:06 nikocraft

Someone (an art director from a mayor gameing studio) made me a job offer based on my work with DD, I had to decline, I'm not looking but DD is insaine when you manage to finetune settings and get the style you like :) image

nikocraft avatar Jul 02 '22 20:07 nikocraft