magic-animate icon indicating copy to clipboard operation
magic-animate copied to clipboard

Automatic1111

Open CoolCuda opened this issue 1 year ago • 8 comments

Hello,

How to install it on Automatic1111 ?

Thank you

CoolCuda avatar Dec 08 '23 01:12 CoolCuda

probably never gonna happen

it is really hard to install. i have stand alone auto installers : https://github.com/magic-research/magic-animate/issues/44

FurkanGozukara avatar Dec 08 '23 10:12 FurkanGozukara

I am A1111 ControlNet + AnimateDiff dev. I will probably do this, but understand that implementing this repo into ControlNet + AnimateDiff extension could be VERY challenging because I need to refactor the whole reference only implementation inside ControlNet extension and I doute if it worth my time. If animate anyone comes out before that happen, I may not support this repo.

continue-revolution avatar Dec 10 '23 09:12 continue-revolution

also this paper just dropped - https://github.com/vvictoryuki/AnimateZero/blob/main/AnimateZero.pdf

johndpope avatar Dec 10 '23 10:12 johndpope

also this paper just dropped - https://github.com/vvictoryuki/AnimateZero/blob/main/AnimateZero.pdf

looks like another cherry picked paper

FurkanGozukara avatar Dec 10 '23 10:12 FurkanGozukara

I know this paper, but I don't like the samples. I also don't like official samples in this repo. I like samples by animate anyone.

continue-revolution avatar Dec 10 '23 10:12 continue-revolution

animate anyone

I feel animate anyone will be also like this repo but we will see if they release

FurkanGozukara avatar Dec 10 '23 10:12 FurkanGozukara

Almost all plug-in based video generators are cherry picked models including those close-source ones. I'm not sure about SVD though. If animate anyone is actually good at making anime girls dance, I would be excited to have it in A1111. This repo cannot do any anime.

continue-revolution avatar Dec 10 '23 10:12 continue-revolution

I am A1111 ControlNet + AnimateDiff dev. I will probably do this, but understand that implementing this repo into ControlNet + AnimateDiff extension could be VERY challenging because I need to refactor the whole reference only implementation inside ControlNet extension and I doute if it worth my time. If animate anyone comes out before that happen, I may not support this repo.

Almost all plug-in based video generators are cherry picked models including those close-source ones. I'm not sure about SVD though. If animate anyone is actually good at making anime girls dance, I would be excited to have it in A1111. This repo cannot do any anime.

Alternatively, without altering the original mechanism of animatediff, would it be better to just use densepose? Additionally, I have been working on video-to-video operations with animatediff for the past two weeks. If we don't rely on a batch of video poses and simply provide a frame count, we can see that animatediff can autonomously produce some smooth movements. However, when it comes to uploading a video and then converting it, it feels like animatediff is just a very automated connector between applications. Am I understanding this correctly?

Li1177 avatar Dec 13 '23 07:12 Li1177