AVT icon indicating copy to clipboard operation
AVT copied to clipboard

Generate submitted file

Open interestingzhuo opened this issue 3 years ago • 3 comments

We can only see the accuracy of validation set, when we run python launch.py -c expts/02_ek100_avt_tsn.txt -l -t.

Can you tell us how to generate the submitted file for the challenge ek100?

interestingzhuo avatar Apr 09 '22 08:04 interestingzhuo

Please see instructions here: https://github.com/facebookresearch/AVT/blob/main/docs/MODELS.md#epic-kitchens-100-testchallenge-submission

rohitgirdhar avatar Apr 10 '22 03:04 rohitgirdhar

Please see instructions here: https://github.com/facebookresearch/AVT/blob/main/docs/MODELS.md#epic-kitchens-100-testchallenge-submission

It seems that the script is used to fuse the results of different model. How can I generate the submitted file using only one model, such as "02_ek100_avt_tsn_test_testonly.txt"? ''python launch.py -c expts/02_ek100_avt_tsn.txt -l -t'' can only evaluate the model in the validation set?

interestingzhuo avatar Apr 10 '22 05:04 interestingzhuo

Hi, apologies for the delay. You can always pass in a single file with weights = 1 and it will generate outputs for that single file. Also since the test set is not public, the code itself can only do evaluation on the val set. For test results you need to submit to the evaluation server.

rohitgirdhar avatar May 20 '22 15:05 rohitgirdhar