Hentai-Diffusion icon indicating copy to clipboard operation
Hentai-Diffusion copied to clipboard

HD-17 seems to make img2img and inpaint progressively darker/grey-ish

Open MarkVelthuis opened this issue 3 years ago • 14 comments

This is especially noticeable with infill as it will show the infill area as a darker. greyer splotch on the image. I have noticed this with another model of which I have forgotten the name. So maybe it's on my end, but HD-16 doesn't show this issue.

MarkVelthuis avatar Dec 12 '22 12:12 MarkVelthuis

Just wanted to chime in that I'm also seeing this. The first image is the txt2img result and the second is the img2img result with nothing being regenerated. Same prompt in both cases. Also seeing these strange blueish spots on img2img outputs. Using the negative prompt didn't change anything. I checked and this issue isn't present in HD-16. fc430878da5cb49115df96faf614bb4c1b99a73d1517dedc082bfb4b 964ee2901367914dc9aa405bd40ffcb2874c24b5b6d0c4fb08dc328a

Kuroseji avatar Dec 12 '22 17:12 Kuroseji

Good to see I'm not the only one. I'd also like to confirm that I'm seeing those blueish/purple spots

MarkVelthuis avatar Dec 12 '22 17:12 MarkVelthuis

I'm really liking the images I've been able to generate from this model, it's great stuff. I will say that I've also noticed the purple splotches and it's the main thing I find myself fighting against. It seems to show up most with img2img and using the Highres. fix, but it also shows up more subtly in normal or higher resolution images.

gnusenpai avatar Dec 13 '22 00:12 gnusenpai

Try using a VAE. Blue artifacts can be eliminated with other samplers/higher step counts.

Rx2TF avatar Dec 16 '22 12:12 Rx2TF

This happens with me as well for some reason, this issue does not show up in the previous model

linklight2 avatar Dec 24 '22 02:12 linklight2

I've been getting good results with the VAE from Anything V3. It seems to have some issues with half precision and higher res images, but it works great in full precision mode (e.g. use --no-half-vae for stable-diffusion-webui). It seems to fix the purple splotches and gives the images a bit more color.

gnusenpai avatar Jan 03 '23 00:01 gnusenpai

This happens with me as well for some reason, this issue does not show up in the previous model

This is a known issue that is being fixed, and should be improved in 19 which will be posted later tonight.

Delcos avatar Jan 04 '23 02:01 Delcos

I am using 22 and my results have been pretty dulled in color as well

draconinjari avatar Mar 01 '23 10:03 draconinjari

Same. I am running serveral anime checkpoints (NovelAI leak, Waifu Diffusion, This one), and all images produced from HD are grainy/grayish, and washed out in color. I tried to combine this with WD to get the best results, but I still get somewhat grainy and washed out results.

Crono141 avatar Apr 07 '23 23:04 Crono141

Use the lora. Manually set it if needed.

Delcos avatar Apr 08 '23 02:04 Delcos

I'm sorry but, which Lora? And where do I find it? The only thing included in the distribution is the checkpoint and the vae, and I'm using both.

On Fri, Apr 7, 2023, 10:03 PM Delcos @.***> wrote:

Use the lora. Manually set it if needed.

— Reply to this email directly, view it on GitHub https://github.com/Delcos/Hentai-Diffusion/issues/17#issuecomment-1500762225, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADG7J2PVFI5DILNPOXE2RQ3XADBQBANCNFSM6AAAAAAS3374TM . You are receiving this because you commented.Message ID: @.***>

Crono141 avatar Apr 08 '23 02:04 Crono141

Sorry. I meant vae. Make sure it's loading it.

Delcos avatar Apr 08 '23 02:04 Delcos

Roger. I dumped both in the same folder (models), but I'm not sure how to tell if the vae is being loaded with the checkpoint. I just renamed it to exactly match the checkpoint name (it was slightly different) but I couldn't tell if its being loaded or not.

On Fri, Apr 7, 2023 at 10:31 PM Delcos @.***> wrote:

Sorry. I meant vae. Make sure it's loading it.

— Reply to this email directly, view it on GitHub https://github.com/Delcos/Hentai-Diffusion/issues/17#issuecomment-1500767395, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADG7J2MDK2UTIHLCGFTT3ZDXADEXJANCNFSM6AAAAAAS3374TM . You are receiving this because you commented.Message ID: @.***>

Crono141 avatar Apr 08 '23 03:04 Crono141

If you're using the UI we provide or Webui by 1111 then under the settings tab there is an option to manually load VAEs. It is usually set to auto but if it isn't changing anything try setting it manually. it will also work with most other anime type models so you shouldn't need to change it back and forth.

Delcos avatar Apr 08 '23 16:04 Delcos