StreamingT2V

StreamingT2V copied to clipboard

how to reduce memory to 16 GPU

1

how to reduce memory to 16 GPU

anthonyyuan

I'd be interested in combining your model with the ones mentioned in the title. Any way to do that?

EightiesPower

Must initialize from damo-vilab/text-to-video-ms-1.7b?

10

Hi, I found that here: https://github.com/Picsart-AI-Research/StreamingT2V/blame/c1b8068bcbcdbbfa0dd0df3371d3c93a1f5132de/t2v_enhanced/model_init.py#L71C7-L71C7 ``` def init_streamingt2v_model(ckpt_file, result_fol): ... cli = CustomCLI(VideoLDM) ``` It seems that VideoLDM must initialized from damo-vilab/text-to-video-ms-1.7b (in config pipeline_repo: damo-vilab/text-to-video-ms-1.7b). Moreover, ckpt_file, which...

Sutongtong233

Thanks for your interesting work. Intuitively, autoregressive generation may result in poor quality after some iterations, which is also reflected in my experiments on this project. But I noticed that...

xizaoqu

I don't know why your framework needs to use a modelscope. But this thing will download a lot of models in Conda's environment. It takes up a lot of space....

lckj2009

Enhanced video length limited to 4sec

5

I am trying to generate 248 frame long sequence. It generates low resolution video of 31 seconds, but the final enhanced video is only 4 sec long. I found this...

ajikmr

Error launching gradio_demo.py under Windows

1

`python gradio_demo.py` gives this error then aborts ``` Traceback (most recent call last): File "D:\Tests\StreamingT2V\StreamingT2V\t2v_enhanced\gradio_demo.py", line 43, in msxl_model = init_v2v_model(cfg_v2v) TypeError: init_v2v_model() missing 1 required positional argument: 'device' ```

SoftologyPro

rm not supported on Windows

1

Any chance you can replace the rm calls with something compatible with both linux and Windows? When running inference.py I get ``` 'rm' is not recognized as an internal or...

SoftologyPro

Some Errors：

3

When I execute the following statement, I get this error:    Why would such an error be reported? I have followed the readme document as normal....

hothot9532

STK2666