Instance-Shadow-Diffusion icon indicating copy to clipboard operation
Instance-Shadow-Diffusion copied to clipboard
Published 7 months ago • verified publisher icon MKFMIKU

Not working on pictures outside dataset

Open yongsuH opened this issue 1 year ago • 6 comments

I have tried to use it on sevaral images. It only makes the shadow grey. output_image_256 How to make it more reliable on other images?

yongsuH avatar Oct 18 '24 02:10 yongsuH

Hi @yongsuH , our method is very robustness to real shadow images as you can see in our video demo https://www.youtube.com/watch?v=WvWBoOZR208. Your results could be lead by incorrect configuration.

You can try our live demo at huggingface space: https://huggingface.co/spaces/MKFMIKU/Instance-Shadow-Removal

MKFMIKU avatar Oct 18 '24 02:10 MKFMIKU

Hi @yongsuH , our method is very robustness to real shadow images as you can see in our video demo https://www.youtube.com/watch?v=WvWBoOZR208. Your results could be lead by incorrect configuration.

You can try our live demo at huggingface space: https://huggingface.co/spaces/MKFMIKU/Instance-Shadow-Removal

I'm using default settings from shadow_aistd_test.py and it gives good results on AISTD images. bacd824e2170f3840e02ff07f845539

yongsuH avatar Oct 18 '24 03:10 yongsuH

Can you try the code and ckpt here: https://huggingface.co/spaces/MKFMIKU/Instance-Shadow-Removal/tree/main ?

MKFMIKU avatar Oct 18 '24 03:10 MKFMIKU

Can you try the code and ckpt here: https://huggingface.co/spaces/MKFMIKU/Instance-Shadow-Removal/tree/main ?

I edited the app.py to run locally, here's the result with dkernel = 11, diffusion_steps = 50 It performs pretty much the same as the code from this git repo. diffusion_output_image

yongsuH avatar Oct 18 '24 20:10 yongsuH

@yongsuH That's interesting. Can you share the original input so I can take a try?

MKFMIKU avatar Oct 18 '24 20:10 MKFMIKU

Sure. test-3 test-3 jpg_shadow_mask

yongsuH avatar Oct 18 '24 20:10 yongsuH