diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

[don't merge] open-sora test pipeline

Open patil-suraj opened this issue 10 months ago • 3 comments

What does this PR do?

A test implementation for open-sora.

pip install git+https://github.com/huggingface/diffusers.git@st-dit
import torch

from diffusers import OpenSoraPipeline
from diffusers.utils import export_to_gif

pipe = OpenSoraPipeline.from_pretrained("diffusers/open-sora-pipe-test", torch_dtype=torch.float16)
pipe.enable_model_cpu_offload()

prompt = "A serene underwater scene featuring a sea turtle swimming through a coral reef. The turtle, with its greenish-brown shell, is the main focus of the video, swimming gracefully towards the right side of the frame. The coral reef, teeming with life, is visible in the background, providing a vibrant and colorful backdrop to the turtle's journey. Several small fish, darting around the turtle, add a sense of movement and dynamism to the scene."

frames = pipe(prompt, decode_chunk_size=4, num_inference_steps=50, guidance_scale=5.0).frames[0]
export_to_gif(frames, "gen.gif", fps=8)

gen

patil-suraj avatar Apr 02 '24 10:04 patil-suraj

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar May 02 '24 15:05 github-actions[bot]