Tune-A-Video
Tune-A-Video copied to clipboard
Published
20 hours ago •
bryandlee
bryandlee
Unofficial implementation of Tune-A-Video
Tune-A-Video
Unofficial implementation of Tune-A-Video
Training
accelerate launch train.py --config config/sample.yml
Notes
- Learning rate and training steps in the sample config are different from the paper.
- The model seems to memorize a video clip very quickly.
prior_preservationis added for the regularization. - Requires > 20GB GPU memory with xformers enabled.
References
- Pseudo 3D Conv & Temporal Attention: https://github.com/lucidrains/make-a-video-pytorch
- Training Code: https://github.com/huggingface/diffusers
- Video Source: https://youtu.be/RC-24Nfr7fc?t=100
bryandlee