MoCha ☕ Video Character Replacement

[RuneGjerde]

I see Kijai "quietly" added yet another model supported ;-)

Seems like its a bit of a character replacement model. Might still be WIP but had to give it a try ;-)

https://orange-3dv-team.github.io/MoCha/

☕

https://github.com/user-attachments/assets/63ccaed4-19a3-48c0-91ef-8c6bd31ac49a

https://github.com/user-attachments/assets/fed529e2-c561-4acf-a002-f859a3de8fb9

[RuneGjerde]

Surprised how well Block Swap seems works with full value (all swapped). I can run 960x544 with 99% VRAM used for 10 minutes (prefetch turned on)... with no OOM (and not that much regular ram used). Seems like a "fix" for those that run into issues with low vram perhaps, just set blockswap to max (but not sure if i'm just being lucky on knife edge, or if its actually so ..)

https://github.com/user-attachments/assets/4d830b4e-bfe2-46f4-8ba4-256da399d951

and this model seems to be really good at making the swap look seamless... shadows, lights, etc .. . impressive

[Songssx]

Animate and InfiniteTalk both support Window, but Mocha doesn’t seem to have Window support. When I use context window, the results turn out poorly

[RuneGjerde]

Animate and InfiniteTalk both support Window, but Mocha doesn’t seem to have Window support. When I use context window, the results turn out poorly

Gave it a test, yes there seems to be a bit of a shift/"morph" if you use Context Window... Not sure if its on the todo, something to come. Or a limitation to be, or some other way to get around it

https://github.com/user-attachments/assets/8892aaf3-a3fa-4c42-88fd-6f9c0600d0c4

(rendered at low steps low res to not have to wait "forever"... so the quality would be better with more, but still...)

[RuneGjerde]

Seems like the mocha guys are cooking up some camera control too ;-) https://orange-3dv-team.github.io/MoCam/ https://github.com/Orange-3DV-Team/MoCam

Not out yet though