ncnet icon indicating copy to clipboard operation
ncnet copied to clipboard

Evaluation script produces no "matches" folder

Open xavierdcruz0 opened this issue 5 years ago • 1 comments

After downloading pretrained models for demo, we ran:

$ python eval_pf_pascal.py --checkpoint trained_models/ncnet_pfpascal.pth.tar

Which resulted in this output:

NCNet evaluation script - PF Pascal dataset
Creating CNN model...
Loading checkpoint...
Using checkpoint parameters: 
  ncons_channels: [16, 16, 1]
  ncons_kernel_sizes: [5, 5, 5]
Downloading: "https://download.pytorch.org/models/resnet101-5d3b4d8f.pth" to /home/ubuntu/.torch/models/resnet101-5d3b4d8f.pth
100%|███████████████████████| 178728960/178728960 [00:16<00:00, 10820718.99it/s]
Copying weights...
Done!
/ebs1/ncnet/lib/pf_dataset.py:31: FutureWarning: Method .as_matrix will be removed in a future version. Use .values instead.
  self.category = self.pairs.iloc[:,2].as_matrix().astype('float')
Batch: [0/299 (0%)]
Batch: [1/299 (0%)]
Batch: [2/299 (1%)]
Batch: [3/299 (1%)]
Batch: [4/299 (1%)]
Batch: [5/299 (2%)]
Batch: [6/299 (2%)]
Batch: [7/299 (2%)]
Batch: [8/299 (3%)]
Batch: [9/299 (3%)]
Batch: [10/299 (3%)]
Batch: [11/299 (4%)]
Batch: [12/299 (4%)]
Batch: [13/299 (4%)]
Batch: [14/299 (5%)]
Batch: [15/299 (5%)]
Batch: [16/299 (5%)]
Batch: [17/299 (6%)]
Batch: [18/299 (6%)]
Batch: [19/299 (6%)]
Batch: [20/299 (7%)]
Batch: [21/299 (7%)]
Batch: [22/299 (7%)]
Batch: [23/299 (8%)]
Batch: [24/299 (8%)]
Batch: [25/299 (8%)]
Batch: [26/299 (9%)]
Batch: [27/299 (9%)]
Batch: [28/299 (9%)]
Batch: [29/299 (10%)]
Batch: [30/299 (10%)]
Batch: [31/299 (10%)]
Batch: [32/299 (11%)]
Batch: [33/299 (11%)]
Batch: [34/299 (11%)]
Batch: [35/299 (12%)]
Batch: [36/299 (12%)]
Batch: [37/299 (12%)]
Batch: [38/299 (13%)]
Batch: [39/299 (13%)]
Batch: [40/299 (13%)]
Batch: [41/299 (14%)]
Batch: [42/299 (14%)]
Batch: [43/299 (14%)]
Batch: [44/299 (15%)]
Batch: [45/299 (15%)]
Batch: [46/299 (15%)]
Batch: [47/299 (16%)]
Batch: [48/299 (16%)]
Batch: [49/299 (16%)]
Batch: [50/299 (17%)]
Batch: [51/299 (17%)]
Batch: [52/299 (17%)]
Batch: [53/299 (18%)]
Batch: [54/299 (18%)]
Batch: [55/299 (18%)]
Batch: [56/299 (19%)]
Batch: [57/299 (19%)]
Batch: [58/299 (19%)]
Batch: [59/299 (20%)]
Batch: [60/299 (20%)]
Batch: [61/299 (20%)]
Batch: [62/299 (21%)]
Batch: [63/299 (21%)]
Batch: [64/299 (21%)]
Batch: [65/299 (22%)]
Batch: [66/299 (22%)]
Batch: [67/299 (22%)]
Batch: [68/299 (23%)]
Batch: [69/299 (23%)]
Batch: [70/299 (23%)]
Batch: [71/299 (24%)]
Batch: [72/299 (24%)]
Batch: [73/299 (24%)]
Batch: [74/299 (25%)]
Batch: [75/299 (25%)]
Batch: [76/299 (25%)]
Batch: [77/299 (26%)]
Batch: [78/299 (26%)]
Batch: [79/299 (26%)]
Batch: [80/299 (27%)]
Batch: [81/299 (27%)]
Batch: [82/299 (27%)]
Batch: [83/299 (28%)]
Batch: [84/299 (28%)]
Batch: [85/299 (28%)]
Batch: [86/299 (29%)]
Batch: [87/299 (29%)]
Batch: [88/299 (29%)]
Batch: [89/299 (30%)]
Batch: [90/299 (30%)]
Batch: [91/299 (30%)]
Batch: [92/299 (31%)]
Batch: [93/299 (31%)]
Batch: [94/299 (31%)]
Batch: [95/299 (32%)]
Batch: [96/299 (32%)]
Batch: [97/299 (32%)]
Batch: [98/299 (33%)]
Batch: [99/299 (33%)]
Batch: [100/299 (33%)]
Batch: [101/299 (34%)]
Batch: [102/299 (34%)]
Batch: [103/299 (34%)]
Batch: [104/299 (35%)]
Batch: [105/299 (35%)]
Batch: [106/299 (35%)]
Batch: [107/299 (36%)]
Batch: [108/299 (36%)]
Batch: [109/299 (36%)]
Batch: [110/299 (37%)]
Batch: [111/299 (37%)]
Batch: [112/299 (37%)]
Batch: [113/299 (38%)]
Batch: [114/299 (38%)]
Batch: [115/299 (38%)]
Batch: [116/299 (39%)]
Batch: [117/299 (39%)]
Batch: [118/299 (39%)]
Batch: [119/299 (40%)]
Batch: [120/299 (40%)]
Batch: [121/299 (40%)]
Batch: [122/299 (41%)]
Batch: [123/299 (41%)]
Batch: [124/299 (41%)]
Batch: [125/299 (42%)]
Batch: [126/299 (42%)]
Batch: [127/299 (42%)]
Batch: [128/299 (43%)]
Batch: [129/299 (43%)]
Batch: [130/299 (43%)]
Batch: [131/299 (44%)]
Batch: [132/299 (44%)]
Batch: [133/299 (44%)]
Batch: [134/299 (45%)]
Batch: [135/299 (45%)]
Batch: [136/299 (45%)]
Batch: [137/299 (46%)]
Batch: [138/299 (46%)]
Batch: [139/299 (46%)]
Batch: [140/299 (47%)]
Batch: [141/299 (47%)]
Batch: [142/299 (47%)]
Batch: [143/299 (48%)]
Batch: [144/299 (48%)]
Batch: [145/299 (48%)]
Batch: [146/299 (49%)]
Batch: [147/299 (49%)]
Batch: [148/299 (49%)]
Batch: [149/299 (50%)]
Batch: [150/299 (50%)]
Batch: [151/299 (51%)]
Batch: [152/299 (51%)]
Batch: [153/299 (51%)]
Batch: [154/299 (52%)]
Batch: [155/299 (52%)]
Batch: [156/299 (52%)]
Batch: [157/299 (53%)]
Batch: [158/299 (53%)]
Batch: [159/299 (53%)]
Batch: [160/299 (54%)]
Batch: [161/299 (54%)]
Batch: [162/299 (54%)]
Batch: [163/299 (55%)]
Batch: [164/299 (55%)]
Batch: [165/299 (55%)]
Batch: [166/299 (56%)]
Batch: [167/299 (56%)]
Batch: [168/299 (56%)]
Batch: [169/299 (57%)]
Batch: [170/299 (57%)]
Batch: [171/299 (57%)]
Batch: [172/299 (58%)]
Batch: [173/299 (58%)]
Batch: [174/299 (58%)]
Batch: [175/299 (59%)]
Batch: [176/299 (59%)]
Batch: [177/299 (59%)]
Batch: [178/299 (60%)]
Batch: [179/299 (60%)]
Batch: [180/299 (60%)]
Batch: [181/299 (61%)]
Batch: [182/299 (61%)]
Batch: [183/299 (61%)]
Batch: [184/299 (62%)]
Batch: [185/299 (62%)]
Batch: [186/299 (62%)]
Batch: [187/299 (63%)]
Batch: [188/299 (63%)]
Batch: [189/299 (63%)]
Batch: [190/299 (64%)]
Batch: [191/299 (64%)]
Batch: [192/299 (64%)]
Batch: [193/299 (65%)]
Batch: [194/299 (65%)]
Batch: [195/299 (65%)]
Batch: [196/299 (66%)]
Batch: [197/299 (66%)]
Batch: [198/299 (66%)]
Batch: [199/299 (67%)]
Batch: [200/299 (67%)]
Batch: [201/299 (67%)]
Batch: [202/299 (68%)]
Batch: [203/299 (68%)]
Batch: [204/299 (68%)]
Batch: [205/299 (69%)]
Batch: [206/299 (69%)]
Batch: [207/299 (69%)]
Batch: [208/299 (70%)]
Batch: [209/299 (70%)]
Batch: [210/299 (70%)]
Batch: [211/299 (71%)]
Batch: [212/299 (71%)]
Batch: [213/299 (71%)]
Batch: [214/299 (72%)]
Batch: [215/299 (72%)]
Batch: [216/299 (72%)]
Batch: [217/299 (73%)]
Batch: [218/299 (73%)]
Batch: [219/299 (73%)]
Batch: [220/299 (74%)]
Batch: [221/299 (74%)]
Batch: [222/299 (74%)]
Batch: [223/299 (75%)]
Batch: [224/299 (75%)]
Batch: [225/299 (75%)]
Batch: [226/299 (76%)]
Batch: [227/299 (76%)]
Batch: [228/299 (76%)]
Batch: [229/299 (77%)]
Batch: [230/299 (77%)]
Batch: [231/299 (77%)]
Batch: [232/299 (78%)]
Batch: [233/299 (78%)]
Batch: [234/299 (78%)]
Batch: [235/299 (79%)]
Batch: [236/299 (79%)]
Batch: [237/299 (79%)]
Batch: [238/299 (80%)]
Batch: [239/299 (80%)]
Batch: [240/299 (80%)]
Batch: [241/299 (81%)]
Batch: [242/299 (81%)]
Batch: [243/299 (81%)]
Batch: [244/299 (82%)]
Batch: [245/299 (82%)]
Batch: [246/299 (82%)]
Batch: [247/299 (83%)]
Batch: [248/299 (83%)]
Batch: [249/299 (83%)]
Batch: [250/299 (84%)]
Batch: [251/299 (84%)]
Batch: [252/299 (84%)]
Batch: [253/299 (85%)]
Batch: [254/299 (85%)]
Batch: [255/299 (85%)]
Batch: [256/299 (86%)]
Batch: [257/299 (86%)]
Batch: [258/299 (86%)]
Batch: [259/299 (87%)]
Batch: [260/299 (87%)]
Batch: [261/299 (87%)]
Batch: [262/299 (88%)]
Batch: [263/299 (88%)]
Batch: [264/299 (88%)]
Batch: [265/299 (89%)]
Batch: [266/299 (89%)]
Batch: [267/299 (89%)]
Batch: [268/299 (90%)]
Batch: [269/299 (90%)]
Batch: [270/299 (90%)]
Batch: [271/299 (91%)]
Batch: [272/299 (91%)]
Batch: [273/299 (91%)]
Batch: [274/299 (92%)]
Batch: [275/299 (92%)]
Batch: [276/299 (92%)]
Batch: [277/299 (93%)]
Batch: [278/299 (93%)]
Batch: [279/299 (93%)]
Batch: [280/299 (94%)]
Batch: [281/299 (94%)]
Batch: [282/299 (94%)]
Batch: [283/299 (95%)]
Batch: [284/299 (95%)]
Batch: [285/299 (95%)]
Batch: [286/299 (96%)]
Batch: [287/299 (96%)]
Batch: [288/299 (96%)]
Batch: [289/299 (97%)]
Batch: [290/299 (97%)]
Batch: [291/299 (97%)]
Batch: [292/299 (98%)]
Batch: [293/299 (98%)]
Batch: [294/299 (98%)]
Batch: [295/299 (99%)]
Batch: [296/299 (99%)]
Batch: [297/299 (99%)]
Batch: [298/299 (100%)]
Total: 299
Valid: 299
PCK: 78.89%

But no folder of output matches was created, for subsequent processing by the Matlab InLoc program.

xavierdcruz0 avatar Jan 24 '19 14:01 xavierdcruz0

Hi, the matches folder is for the InLoc evaluation. In this case you are running the PF Pascal evaluation, the PCK result is shown in the last line of the output.

ignacio-rocco avatar Jan 27 '19 23:01 ignacio-rocco