caffe-video_triplet icon indicating copy to clipboard operation
caffe-video_triplet copied to clipboard

Published 20 hours ago • verified publisher icon xiaolonw

about input image list

Open Robert0812 opened this issue 8 years ago • 6 comments

Is the input image list in an order like 1 1 2 2 3 3 ... ? Or randomly arranged? Will there be a duplicated file name in the list?

Robert0812 avatar Sep 29 '15 10:09 Robert0812

Sorry, I did not see this earlier, it is like this: E5K-WUqpmvw/pairs2/0000001_1.jpg 1 E5K-WUqpmvw/pairs2/0000001_2.jpg 1 E5K-WUqpmvw/pairs2/0000002_1.jpg 1 E5K-WUqpmvw/pairs2/0000002_2.jpg 1 E5K-WUqpmvw/pairs2/0000003_1.jpg 1 E5K-WUqpmvw/pairs2/0000003_2.jpg 1 ... DmeLCEonmfk/pairs2/0000002_1.jpg 82902 DmeLCEonmfk/pairs2/0000002_2.jpg 82902 sj_uxLHFGMQ/pairs2/0000001_1.jpg 82903 sj_uxLHFGMQ/pairs2/0000001_2.jpg 82903

different labels behind each line indicate different videos, in this case, there are 82903 videos.

xiaolonw avatar Dec 06 '15 04:12 xiaolonw

@xiaolonw how do I specify that each pair is together, or each 2 are selected in order?

nassarofficial avatar Nov 08 '16 14:11 nassarofficial

@xiaolonw Sorry,I don't understand.For example, "E5K-WUqpmvw/pairs2/0000001_1.jpg 1"and "E5K-WUqpmvw/pairs2/0000001_2.jpg 1"are pairs from the same video, and they will be taken as similar patches,is it right? And your imagenet_train.prototxt/image_data_param has "shuffle: true" .It means randomly input image.So can the pairs above be input in the same batch?

visgcourse avatar Nov 23 '16 14:11 visgcourse

@nassarofficial @xiaolonw I have read the code，and understand it now . In the input image list,"E5K-WUqpmvw/pairs2/0000001_1.jpg 1" and"E5K-WUqpmvw/pairs2/0000001_2.jpg 1" is a pair.

  • In fact 0000001means first pair, 0000002 means second pair, and so on.
  • "_1" and "_2" means the two image in the pair.
  • The label 1,2...82903 indicate different videos. The rank_hard_loss will check whether label of images in a pair are the same.

"shuffle: true" will randomly input image. But the author change the code. So the pairs will be randomly input one by one, not the images.

visgcourse avatar Nov 24 '16 04:11 visgcourse

@xiaolonw Hi

  • I can not open the 'https://www.dropbox.com/sh/b9rgd8nkh498kuy/AACt6Gk8V7-f8Yq7qVSCs5TGa?dl=0' Could you please update the URL please?Thanks!

Kevin35Day avatar Apr 12 '17 08:04 Kevin35Day

You can use

"tar -R --ignore-failed-read --ignore-command-error --ignore-zeros -xf collect.tar & "

to force tar ignore corrupted blocks.

ghost avatar Apr 16 '17 06:04 ghost