InCTRL icon indicating copy to clipboard operation
InCTRL copied to clipboard

The performance of using 4-shot or 8-shot on the Visa dataset is similar to that of 2-shot

Open guangpintao opened this issue 1 year ago • 2 comments

Hello, I validated the 8-shot performance using the provided pre-trained model and few shot samples, and the results were similar to 2-shot, not as high as mentioned in the paper. I did the following: (1) checkpoints/8/checkpoint.pyth modified TEST CHECKPOINT-FILE-PATH (2) changed/fs_samples/visa/2/in the provided test command to/fs_samples/visa/8/, results are as follows: image Did I miss any operational steps?

guangpintao avatar Apr 18 '24 15:04 guangpintao

您好,训练的命令时要一个类别一个类别的训练吗?

Qi-Ran avatar Apr 21 '24 11:04 Qi-Ran

Hello, I validated the 8-shot performance using the provided pre-trained model and few shot samples, and the results were similar to 2-shot, not as high as mentioned in the paper. I did the following: (1) checkpoints/8/checkpoint.pyth modified TEST CHECKPOINT-FILE-PATH (2) changed/fs_samples/visa/2/in the provided test command to/fs_samples/visa/8/, results are as follows: image Did I miss any operational steps?

I also checked the performance on my device, my result is similar as stated in the paper. Here is my result: 5ae17fadcd3a3619fa8016b31ef6a7c

REDriver2023 avatar Apr 22 '24 13:04 REDriver2023