Nattapol

Hi, thanks for reporting these issues. 1. The fix has already been updated to the master branch, it will be included in the newer pypi release. In the meantime, you...

I could not replicate this issue. Can you provide the packages version and run command? It should not return a Tensor as it was already reset back to native at...

I still cannot replicate the error. Can you give me the versions and run command? That will be helpful.

You can install with the latest version of detectron2 and remove these version rules from `requirements.txt`: https://github.com/Vchitect/VBench/blob/fe06fcc93866630370ec6caccd82dcfb46fc22b6/requirements.txt#L5-L6 https://github.com/Vchitect/VBench/blob/fe06fcc93866630370ec6caccd82dcfb46fc22b6/requirements.txt#L27 and install detectron2 with: `pip install detectron2@git+https://github.com/facebookresearch/detectron2.git`

Seems to work fine for me. Here is `pip list` ```bash Package Version ------------------------ ------------------ absl-py 2.1.0 accelerate 0.32.1 addict 2.4.0 antlr4-python3-runtime 4.9.3 asttokens 2.4.1 black 24.4.2 boto3 1.34.144 botocore...

You can use the requirements.txt from [here](https://github.com/Vchitect/VBench/blob/4427aa8c0f5c3888b91e6fdaf4b6bb57a9af91e5/requirements.txt). Then after that you can install detectron2 using: pip install detectron2@git+https://github.com/facebookresearch/detectron2.git

`Temporal Style`, `Appearance Style`, `Scene`, `Spatial Relationship`, `Color`, `Human Action`, `Multiple Objects`, `Object Class` and `Dynamic Degree`. You can find more detail for each metric in the [paper](https://arxiv.org/pdf/2311.17982).

Can you provide `ls -lh ~/.cache/vbench/*` and version here? Seems like the problem is not specific to CLIP as subject_consistency does not use it (https://github.com/Vchitect/VBench/issues/87).

The numbers are fine for me, ``` { "subject_consistency": [ 0.9419299250653854, [ { "video_path": "../Mochi/subject_consistency/a person swimming in ocean-0.mp4", "video_results": 0.9451899988415801 }, { "video_path": "../Mochi/subject_consistency/a person swimming in ocean-1.mp4", "video_results":...

The videos i tested are actually from the mochi google drive you mentioned, so it should be the same videos you tested. Any mp4 video should work for testing, and...