Wenhao Chai comments

Results 22 comments of


                                            Wenhao Chai

How to set "use_fsdp=True" with "SLURM_LOCALID" and "SLURM_PROCID" for multi-gpus training?

also stuck at training by using srun

Can you add some typical RNN or Transformer structures on ./example

same here hha :)

Lot of issues making this work. Now: EOFError: Ran out of input

As for install controlnet, the weights should be download and place following in the structure shown in README.md, then the weights can be loaded

How to extract video frames?

u can use [ffmepg](https://ffmpeg.org/) to do so :), there is no fixed frame numbers for a video, but make sure dont introduce very low fps or large motion. good luck

how to click the render botton without a GUI?

@MeowDWing @zhanchao019 gradio is nothing but a GUI. You can easily rewrite the code to execute functions in main class directly rather than using “click”

ModuleNotFoundError: No module named "taming"

> The packaging of this code is just a mess. A good requirements.txt is missing. To solve this issue you just need to clone this repo: https://github.com/CompVis/taming-transformers.git And the add...

All video/ gifs seems to have the "shutterstock" watermark at the same location.

same issue

how to use Steve to directly describe a minecraft video?

U can start with running the whole framework correctly, and the sequence description can be found in log.

ERROR: Could not find a version that satisfies the requirement triton==2.0.0 (from versions: none) ERROR: No matching distribution found for triton==2.0.0

according to [this](https://github.com/openai/triton/issues/1527), it seems happen only on windows. also detailed command may help us solve your problem. ty~