3D-ResNets-PyTorch icon indicating copy to clipboard operation
3D-ResNets-PyTorch copied to clipboard

unable to create val.json

Open suravijayjilla opened this issue 3 years ago • 4 comments

Hi,

Executed the code with the default dataset. Trained the model with kinetics dataset after successful training. Unable to find a val.json for evaluation. Please let me know how to generate the val.json file.

suravijayjilla avatar Apr 21 '21 14:04 suravijayjilla

@suravijayjilla have you run the inference to generate the val.json? You should run it before calculate the top 1 accuracy. image

guilhermesurek avatar Apr 23 '21 23:04 guilhermesurek

@ @guilhermesurek Hi, can only KINETICS data set calculate top1 accuracy? How is the UCF101 dataset calculated? I get an error using these two lines, and the ground_truth of the load_ground_truth function is 0 in util_scripts/ eval_specification. py

for video_id, v in data['database'].items():
        if subset != v['subset']:
            continue
        this_label = v['annotations']['label']
        ground_truth.append((video_id, class_labels_map[this_label]))

I think there is a mistake here. Do you know how to change this part of the code

YTHmamba avatar Jul 09 '22 12:07 YTHmamba

@YTHmamba I didn't run in UCF101, but the code seems to be generic, independent of the dataset. Try to check if your inference json (or val.json) is similar to your ground truth json. Or could be any difference in the class_labels_map.

guilhermesurek avatar Jul 15 '22 20:07 guilhermesurek

@YTHmamba我没有在 UCF101 中运行,但代码似乎是通用的,独立于数据集。尝试检查您的推理 json(或 val.json)是否与您的基本事实 json 相似。或者可能是 class_labels_map 中的任何差异。

@guilhermesurek Thank you very much. Is the clip accuracy of the paper the identification accuracy of 16 frames? How is the accuracy of TOP1 video level calculated? What is the logic?

YTHmamba avatar Jul 16 '22 02:07 YTHmamba