Open-Sora-Plan

Open-Sora-Plan copied to clipboard

Can't set attribute in modeling_vqvae

2

File "opensora/train/train_videogpt.py", line 55, in train(args, vqvae_args, training_args) File "opensora/train/train_videogpt.py", line 39, in train config = VQVAEConfiguration(**asdict(vqvae_args)) File "/hetero_infer/hanxudong.hxd/Open-Sora-Plan/opensora/models/ae/videobase/vqvae/modeling_vqvae.py", line 718, in __init__ self.config = config File "/opt/conda/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1754,...

hxdtest

Gymat

Process stuck

5

I am trying to run the process through the instructions given (this command in particular - sh scripts/text_condition/sample_video.sh).. but after a series of warnings the process freezes . ``` workspace/Open-Sora-Plan/venv/lib/python3.10/site-packages/torch/nn/modules/module.py:2025:...

piyushK52

How do you solve motion blurring in CausalVideoVAE?

3

Thanks for your released code. I want to ask how do you solve the motion blurring in CausalVideoVAE? add more parameters in time downsample/upsample? And according to my training results,...

Birdylx

stepbystep88

Adde code in ./opensora/models/navit, which includes NaViT, its video version and training script (currently following the original paper, training tasks include image classification and language-image contrastive learning). In the future,...

XCX-scholar

Since there is no parameter in TimeDownsample2x and TimeUpsample2x for time compress which is discussed in #145 , here we can insert CausalConv3d into these down/up layers and initialize this...

Birdylx

Hello: Very outstanding work! Can you provide a tutorial on fine-tuning based on the Open-Sora-Plan v1.0.0 model? Thank you so much!

COST-97

这应该是 VIdeo-VQVAE 而不是 Video-VQGan？

1

wwn1233

ckgithub2019