VideoGPT

VideoGPT copied to clipboard

How to predict next frames using one frame

2

Hello! Thanks for your work, I have a question about prediction, in VideoGPT (BAIR), how should I predict 15 frames from 1 frame? I don't know whether I need to...

Mu-Yanchen

Where can I find the code related to the moving MNIST experiments?

V0XNIHILI

VQ-VAE VQ-loss is missing? only find reconstruct, and commitment loss

1

Hi, I am currently studying the VideoGPT and have some doubts on VQ-VAE losses. Where is VQ loss? - In the original [paper](https://arxiv.org/pdf/1711.00937.pdf), there're 3 loss, a reconstruction loss, a...

yiqiwang8177

Hi, great work! I have a somewhat naive doubt. Just curious, why not limit VQVAE to model space instead of space-time? Thus, exploiting the autoregressive nature of the transformer to...

Piyush-555

Hello, in videoGPT, if I use the ucf101 dataset for training and change the model stride (such as 2x16x16). Will the dimensions of the codebook change accordingly? If it changes,...

qklee-lz

Running on 4 V100s, but epoch stays at 0

6

I'm running the model on 4 V100 GPUs using SLURM and the following sbatch script: ``` #!/bin/bash #SBATCH -p gpu #SBATCH --gres=gpu:4 #SBATCH -p reserved --reservation=slerman-20210821 -t 2-00:00:00 #SBATCH -t...

slerman12

Extending your code for poses

1

This is a "support" request rather than a bug or a feature. ---- ## Idea I have a "video" sequence that is represented as skeletal poses rather than video frames....

AmitMY

Issue with memory only with your code

1

I got the following error while running train_vqvae.py: `OSError: [WinError 1455] The paging file is too small for this operation to complete. Error loading "C:\Users\sebdb\Anaconda3\envs\pythonProject\lib\site-packages\torch\lib\cusolver64_10.dll" or one of its dependencies`...

Scienceseb

FVD score not conform to what's reported in the paper

5

Hi, I tested the Bair pre-trained VideoGPT model, but your evaluation script reported FVD to be 1000+, however FVD* was around 100, probably there's a mistake with your evaluation script?

Gabriel-Huang

Compute compatibility?

6

Would you happen to have a rough estimate of the kind of compute needed to run this model? Unfortunately, we are subject to a very limited compute scenario and I...

slerman12