Open-Sora
Open-Sora copied to clipboard
hpcaitech
Open-Sora: Democratizing Efficient Video Production for All
And how should we use it in training and sampling? Thanks!
I wanted to share a quick demonstration of a home use case for this that I made: https://youtu.be/tiQpw50lKjU Great job and thanks very much for releasing this for local use!...
[2024-06-29 05:36:29] Beginning epoch 0... Epoch 0: 0it [00:00, ?it/s] INFO: Pandarallel will run on 16 workers. INFO: Pandarallel will use Memory file system to transfer data between the main...
In the current code, if Flash Attention is not available, models.layers.blocks.Attention falls back to naive attention which directly materializes the attention matrix, OOM'ing immediately even for modest generation lengths. Can...
多机实验hang住问题
多机实验，没有明显的报错，节点与master失联，以及1.2这个版本的RDMA怎么开启？ 2024-06-30 18:08:30 - Avoid using `tokenizers` before the fork if possible 2024-06-30 18:08:30 - Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false) 2024-06-30 18:08:30 huggingface/tokenizers: The current process just...
 1.为什么这里对z进行concat，然后有对模型输出结果pred做chunk？ 我的例子： 运行推理 `python3 scripts/inference.py configs/opensora-v1-2/inference/sample.py --num-frames 120 --image-size 640 640 --sample-name connect --prompt 'Generate a video of the motion of the meteorological radar precipitation field based on the...
在luchen cloud 上微调opensora的时候 请问如何指定--ckpt-path这个参数呢？ 无论是指定 --ckpt-path /root/commonData/OpenSora-STDiT-v3 --ckpt-path /root/commonData/OpenSora-STDiT-v3/model.safetensors --ckpt-path xx/model.pth (safetensor转的pth) 都会报错 ckpt_utils.py也看了 完全封装起来了，没找到修改的地方 谢谢
First of all, we greatly appreciate such outstanding work. We are currently using OpenSora for some experiments but have encountered an issue： The network architecture of Opensora 1.2 is significantly...
你好，请教一下： 1.看到代码中dataset有对图像处理的代码，但是在训练的脚本中没有看到在任何地方输入图片csv，是不是图像和视频的csv文件是混合在一起成一个大的csv？ 2. 如果是图像和视频联合训练的话，那么各个阶段图像和视频的比例分别是多少？
