diffusers
diffusers copied to clipboard
[don't merge] open-sora test pipeline
What does this PR do?
A test implementation for open-sora.
pip install git+https://github.com/huggingface/diffusers.git@st-dit
import torch
from diffusers import OpenSoraPipeline
from diffusers.utils import export_to_gif
pipe = OpenSoraPipeline.from_pretrained("diffusers/open-sora-pipe-test", torch_dtype=torch.float16)
pipe.enable_model_cpu_offload()
prompt = "A serene underwater scene featuring a sea turtle swimming through a coral reef. The turtle, with its greenish-brown shell, is the main focus of the video, swimming gracefully towards the right side of the frame. The coral reef, teeming with life, is visible in the background, providing a vibrant and colorful backdrop to the turtle's journey. Several small fish, darting around the turtle, add a sense of movement and dynamism to the scene."
frames = pipe(prompt, decode_chunk_size=4, num_inference_steps=50, guidance_scale=5.0).frames[0]
export_to_gif(frames, "gen.gif", fps=8)
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
Please note that issues that do not follow the contributing guidelines are likely to be ignored.