Open-Sora-Plan

Open-Sora-Plan copied to clipboard

请问生成视频的长度能否控制呢？

2

当前是生成2秒。是否有超参数可以设置呢？

wyfwyf556

causalVAE的训练适配NPU了吗？

1

我尝试用npu训练causalVAE，出现如下报错： Building datasets... /home/m00830934/anaconda3/envs/opensora-plan/lib/python3.8/site-packages/torch_npu/npu/utils.py:88: UserWarning: torch.npu.get_device_capability isn't implemented! warnings.warn("torch.npu.get_device_capability isn't implemented!") Traceback (most recent call last): File "/home/m00830934/code/Open-Sora-Plan/opensora/train/train_causalvae.py", line 108, in train(args[0]) File "/home/m00830934/code/Open-Sora-Plan/opensora/train/train_causalvae.py", line 97, in train trainer.fit( File...

momandai

下载安装之后，如何根据 Text Prompt 来生成视频？

2

下载安装之后，如何根据 Text Prompt 来生成视频？在 Usage 部分没有找到使用教程，有无好心人可以帮帮我？

FangehaPlus

mrlihellohorld

有没有训练好的模型文件?

3

如题。

FANGEHA

Hi, I noticed that pre-extracting features for 512-frame videos can significantly reduce memory usage. Could you please share the code for pre-computing video and T5 features? Additionally, the memory savings...

knightyxp

can you provide the caption prompt used for llava1.6 or share captioner ?

1

valencebond

Failed loading VAE checkpoint

1

Thank you for your wonderful contributions! I have some issues with the loading of VAE checkpoint. when loading the checkpoint (https://huggingface.co/LanguageBind/Open-Sora-Plan-v1.0.0/tree/main/vae), we found that code `vae = CausalVAEModel.from_pretrained('./ckpt/Open-Sora-Plan-v1.0.0/vae/')` raises error...

ROGERDJQ

Synthetic video generation

1

Hello, We are making a synthetic data generator and would like to contribute data to the project: https://simian.mov/ https://raccoonresearch.github.io/Simian/ For example: *Wide shot of Tyranomon. Camera at 45 degree angle...

lalalune

Add support snr_gamma for rebalancing loss. Reference https://arxiv.org/abs/2303.09556

Pang-Yatian