stable-diffusion-webui icon indicating copy to clipboard operation
stable-diffusion-webui copied to clipboard

[Feature Request]: Implement Stable Video Diffusion model (SVD)

Open hoblin opened this issue 7 months ago • 27 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues and checked the recent builds/commits

What would your feature do?

Stability AI just dropped their new model Stable Video Diffusion Weights are already available for download. Here is the paper

It would be awesome to have it in the most popular SD UI

Proposed workflow

  1. Go to text-2-video tab
  2. Enter the prompt
  3. Click Generate
  4. Enjoy the show

Additional information

No response

hoblin avatar Nov 21 '23 22:11 hoblin

Some useful tips and tricks on what's the optimal parameters from one of the developers: https://x.com/timudk/status/1727064128223855087?s=20

hoblin avatar Nov 22 '23 00:11 hoblin

https://github.com/continue-revolution/sd-webui-animatediff/issues/339#issuecomment-1822207493

w-e-w avatar Nov 22 '23 07:11 w-e-w

the world is waiting

andzejsp avatar Nov 23 '23 07:11 andzejsp

should rename to have SVD in title https://x.com/fofrAI/status/1727620324563251494?s=20

found this https://github.com/kijai/ComfyUI-SVD

https://github.com/replicate/cog-svd

johndpope avatar Nov 24 '23 07:11 johndpope

should rename to have SVD in title https://x.com/fofrAI/status/1727620324563251494?s=20

found this https://github.com/kijai/ComfyUI-SVD

https://github.com/replicate/cog-svd

why do they only have 14 or 25 frames? i thought you can generate as much as you want? And im waiting on automatic1111 to have this implemented, i dont want to move around my checkpoints

andzejsp avatar Nov 24 '23 07:11 andzejsp

+1 for this.

sinand99 avatar Nov 28 '23 19:11 sinand99

+1

fuxiocteract avatar Nov 30 '23 06:11 fuxiocteract

+1

oscarbg avatar Dec 02 '23 04:12 oscarbg

continue-revolution have said that he won't be able to support this in sd-webui-animatediff until next week Wednesday at the earliest, no guarantees on the exact time as he's currently busy with all the matters see post https://github.com/continue-revolution/sd-webui-animatediff/issues/351

please stop the +1 spam

w-e-w avatar Dec 02 '23 04:12 w-e-w

Boom 💥 https://github.com/xx025/stable-video-diffusion-webui

johndpope avatar Dec 04 '23 10:12 johndpope

Boom 💥 https://github.com/xx025/stable-video-diffusion-webui

is this only img to video? can it run txt 2 vid?

andzejsp avatar Dec 04 '23 10:12 andzejsp

continue-revolution have said that he won't be able to support this in sd-webui-animatediff until next week Wednesday at the earliest, no guarantees on the exact time as he's currently busy with all the matters see post continue-revolution/sd-webui-animatediff#351

please stop the +1 spam

We need official native support in a txt2video tab. Not crappy extensions.

sinand99 avatar Dec 04 '23 16:12 sinand99

related - https://github.com/thecooltechguy/ComfyUI-MagicAnimate

johndpope avatar Dec 08 '23 07:12 johndpope

+1

derpina-ai avatar Dec 09 '23 12:12 derpina-ai

+1

Nandop2000 avatar Dec 13 '23 07:12 Nandop2000

Can a contrib or owner lock this thread? i don't want the email spam

taybart avatar Dec 16 '23 21:12 taybart

@taybart You can just unsubscribe to it

enriquemorenotent avatar Dec 16 '23 21:12 enriquemorenotent

@enriquemorenotent i'm interested in the feature, i want updates about it...not that someone wants it? +1 spam is annoying

taybart avatar Dec 16 '23 21:12 taybart

@taybart So, if you are interested in the feature... why would you want the thread locked?

You want the feature, but the discussion of the feature is (understandably) annoying you. It is kind of a paradoxical situation. You might be better off bookmarking it, and unsubscribing.

enriquemorenotent avatar Dec 16 '23 21:12 enriquemorenotent

@taybart So, if you are interested in the feature... why would you want the thread locked?

You want the feature, but the discussion of the feature is (understandably) annoying you. It is kind of a paradoxical situation. You might be better off bookmarking it, and unsubscribing.

People do it because developers ignore us. So it is better to bump it

+1 +1 +1

sinand99 avatar Dec 16 '23 21:12 sinand99

People do it because developers ignore us. So it is better to bump it

Opensource doesn't work this way. If you want this feature - you implement it and create PR. Developers don't owe anything to anybody because they are doing this for free. So, if you're not going to work on a feature, stop the flood in the issue please. There are more that 1700 other issues they need to address.

Be patient everybody pretty please.

hoblin avatar Dec 16 '23 21:12 hoblin

People do it because developers ignore us. So it is better to bump it

People do it, because they want to show the interest in the feature. Even though arguably a :+1: in the opening post should be just as efficient to do that

enriquemorenotent avatar Dec 16 '23 21:12 enriquemorenotent

People do it because developers ignore us. So it is better to bump it

People do it, because they want to show the interest in the feature. Even though arguably a 👍 in the opening post should be just as efficient to do that

Yes this is one of the most requested features now and it has been one month, and I see no progress.

sinand99 avatar Dec 16 '23 21:12 sinand99

make it yourself then, this is open source lmao

taybart avatar Dec 16 '23 21:12 taybart

People do it because developers ignore us. So it is better to bump it

People do it, because they want to show the interest in the feature. Even though arguably a 👍 in the opening post should be just as efficient to do that

Yes this is one of the most requested features now and it has been one month, and I see no progress.

We have the right to show interest, but not the right to demand the developers to do it.

Like others said, if you want it so badly... do it yourself :)

enriquemorenotent avatar Dec 16 '23 21:12 enriquemorenotent

For all these new folks here. "+1" on GitHub is considered a very bad taste. As well as arguing ^_^ Let's keep discussions productive please.

hoblin avatar Dec 16 '23 21:12 hoblin

sd-webui-forge fork have implementation of SVD. Maybe somebody will adapt it for original webui? https://github.com/lllyasviel/stable-diffusion-webui-forge/blob/main/extensions-builtin/sd_forge_svd/scripts/forge_svd.py

sebaxakerhtc avatar Apr 21 '24 18:04 sebaxakerhtc