VBench
VBench copied to clipboard
Vchitect
[CVPR2024 Highlight] VBench - We Evaluate Video Generation
Currently Vbench can evaluate on the list of dimension ['subject_consistency', 'background_consistency', 'temporal_flickering', 'motion_smoothness', 'dynamic_degree', 'aesthetic_quality', 'imaging_quality', 'object_class', 'multiple_objects', 'human_action', 'color', 'spatial_relationship', 'scene', 'temporal_style', 'appearance_style', 'overall_consistency'] I run some of them...
Hi, I install VBench with pip, but I encountered some problems. 1. I encountered the following error when evaluating motion_smoothness: 2. At line 61 in `vbench/dynamic_degree.py`, line 110 in `vbench/motion_smoothness.py`...
I understand we can run inference on customized video (as in https://github.com/Vchitect/VBench/issues/7). However, can we run inference on both customized video and prompt?
as the title
Hello, author. After reading your paper, I have some doubts about certain details. May I directly input a video clip (without any prompts) for evaluation? Is your method applicable to...
Thanks for your great work, I want to know where can I find those generated videos mentioned in the paper?
Hi, Dose Vbench have limitation on the video size and the number of frames for generated videos? What is the setting of the video size and the number of frames...
I wrote a script for evaluation,but I encoutered a issue then: 1、script: from vbench import VBench import torch device = torch.device("cuda") my_VBench = VBench(device, "VBench_full_info.json", "evaluation_results") my_VBench.evaluate( videos_path = "./videocrafter/spatial_relationship",...
Hi, the path "prompts/prompts_per_dimension" contains only a part of evaluation dimensions. So, if i want to evaluation the dimension of "background_consistent", and there is no proper prompt text file (maybe...
