echomimic icon indicating copy to clipboard operation
echomimic copied to clipboard

Eye Glitch + Steps Test (Gradio Configuration)

Open oisilener1982 opened this issue 1 year ago • 6 comments

100 Steps

https://github.com/user-attachments/assets/22e50911-e0cf-413e-bdce-71073f1b6866

50 Steps in configuration

https://github.com/user-attachments/assets/efe80d56-e010-4c5d-b2f9-c777393f7b2b

20 steps

https://github.com/user-attachments/assets/97eb5923-9862-48f8-8b09-50cb293c1e7e

30 steps

https://github.com/user-attachments/assets/91f45ba5-cb9a-491b-8c6f-0245d706ac52

Is there any way to minimize the eye glitch at the end?

oisilener1982 avatar Jul 15 '24 15:07 oisilener1982

The eye glitch becomes more prominent if the number of steps is reduced to 20 (default 30) in gradio configuration If it is increased to 50 it just happened at the end wherein one eye would close 100 steps also improved the result

This is the source picture IVANA

oisilener1982 avatar Jul 15 '24 15:07 oisilener1982

Another example with one with an eye glitch and the second without

https://github.com/user-attachments/assets/d6a94e6d-a2f0-4ba8-98c5-eec7c38439d8

https://github.com/user-attachments/assets/d8c56cc6-f5de-413a-a260-0ea9ed59c630

oisilener1982 avatar Jul 15 '24 16:07 oisilener1982

Another example with one with an eye glitch and the second without

2nd also have eye glitch at the end but minimal

image

I have also noticed this issue in the videos I created.

nitinmukesh avatar Jul 15 '24 18:07 nitinmukesh

One possible solution would be to add 1 second audio at the end then cut the additional video in capcut but it would be nice if this can be fixed

BTW, Hedra's eye glitch is much worse.

oisilener1982 avatar Jul 15 '24 20:07 oisilener1982

Thanks for your feedback. It seems to be a corner case of EchoMimic, we will try to fix it.

JoeFannie avatar Jul 16 '24 07:07 JoeFannie

How do the eyes move?

xiaolaos avatar Aug 23 '24 09:08 xiaolaos