ncnet
ncnet copied to clipboard
Evaluation script produces no "matches" folder
After downloading pretrained models for demo, we ran:
$ python eval_pf_pascal.py --checkpoint trained_models/ncnet_pfpascal.pth.tar
Which resulted in this output:
NCNet evaluation script - PF Pascal dataset
Creating CNN model...
Loading checkpoint...
Using checkpoint parameters:
ncons_channels: [16, 16, 1]
ncons_kernel_sizes: [5, 5, 5]
Downloading: "https://download.pytorch.org/models/resnet101-5d3b4d8f.pth" to /home/ubuntu/.torch/models/resnet101-5d3b4d8f.pth
100%|███████████████████████| 178728960/178728960 [00:16<00:00, 10820718.99it/s]
Copying weights...
Done!
/ebs1/ncnet/lib/pf_dataset.py:31: FutureWarning: Method .as_matrix will be removed in a future version. Use .values instead.
self.category = self.pairs.iloc[:,2].as_matrix().astype('float')
Batch: [0/299 (0%)]
Batch: [1/299 (0%)]
Batch: [2/299 (1%)]
Batch: [3/299 (1%)]
Batch: [4/299 (1%)]
Batch: [5/299 (2%)]
Batch: [6/299 (2%)]
Batch: [7/299 (2%)]
Batch: [8/299 (3%)]
Batch: [9/299 (3%)]
Batch: [10/299 (3%)]
Batch: [11/299 (4%)]
Batch: [12/299 (4%)]
Batch: [13/299 (4%)]
Batch: [14/299 (5%)]
Batch: [15/299 (5%)]
Batch: [16/299 (5%)]
Batch: [17/299 (6%)]
Batch: [18/299 (6%)]
Batch: [19/299 (6%)]
Batch: [20/299 (7%)]
Batch: [21/299 (7%)]
Batch: [22/299 (7%)]
Batch: [23/299 (8%)]
Batch: [24/299 (8%)]
Batch: [25/299 (8%)]
Batch: [26/299 (9%)]
Batch: [27/299 (9%)]
Batch: [28/299 (9%)]
Batch: [29/299 (10%)]
Batch: [30/299 (10%)]
Batch: [31/299 (10%)]
Batch: [32/299 (11%)]
Batch: [33/299 (11%)]
Batch: [34/299 (11%)]
Batch: [35/299 (12%)]
Batch: [36/299 (12%)]
Batch: [37/299 (12%)]
Batch: [38/299 (13%)]
Batch: [39/299 (13%)]
Batch: [40/299 (13%)]
Batch: [41/299 (14%)]
Batch: [42/299 (14%)]
Batch: [43/299 (14%)]
Batch: [44/299 (15%)]
Batch: [45/299 (15%)]
Batch: [46/299 (15%)]
Batch: [47/299 (16%)]
Batch: [48/299 (16%)]
Batch: [49/299 (16%)]
Batch: [50/299 (17%)]
Batch: [51/299 (17%)]
Batch: [52/299 (17%)]
Batch: [53/299 (18%)]
Batch: [54/299 (18%)]
Batch: [55/299 (18%)]
Batch: [56/299 (19%)]
Batch: [57/299 (19%)]
Batch: [58/299 (19%)]
Batch: [59/299 (20%)]
Batch: [60/299 (20%)]
Batch: [61/299 (20%)]
Batch: [62/299 (21%)]
Batch: [63/299 (21%)]
Batch: [64/299 (21%)]
Batch: [65/299 (22%)]
Batch: [66/299 (22%)]
Batch: [67/299 (22%)]
Batch: [68/299 (23%)]
Batch: [69/299 (23%)]
Batch: [70/299 (23%)]
Batch: [71/299 (24%)]
Batch: [72/299 (24%)]
Batch: [73/299 (24%)]
Batch: [74/299 (25%)]
Batch: [75/299 (25%)]
Batch: [76/299 (25%)]
Batch: [77/299 (26%)]
Batch: [78/299 (26%)]
Batch: [79/299 (26%)]
Batch: [80/299 (27%)]
Batch: [81/299 (27%)]
Batch: [82/299 (27%)]
Batch: [83/299 (28%)]
Batch: [84/299 (28%)]
Batch: [85/299 (28%)]
Batch: [86/299 (29%)]
Batch: [87/299 (29%)]
Batch: [88/299 (29%)]
Batch: [89/299 (30%)]
Batch: [90/299 (30%)]
Batch: [91/299 (30%)]
Batch: [92/299 (31%)]
Batch: [93/299 (31%)]
Batch: [94/299 (31%)]
Batch: [95/299 (32%)]
Batch: [96/299 (32%)]
Batch: [97/299 (32%)]
Batch: [98/299 (33%)]
Batch: [99/299 (33%)]
Batch: [100/299 (33%)]
Batch: [101/299 (34%)]
Batch: [102/299 (34%)]
Batch: [103/299 (34%)]
Batch: [104/299 (35%)]
Batch: [105/299 (35%)]
Batch: [106/299 (35%)]
Batch: [107/299 (36%)]
Batch: [108/299 (36%)]
Batch: [109/299 (36%)]
Batch: [110/299 (37%)]
Batch: [111/299 (37%)]
Batch: [112/299 (37%)]
Batch: [113/299 (38%)]
Batch: [114/299 (38%)]
Batch: [115/299 (38%)]
Batch: [116/299 (39%)]
Batch: [117/299 (39%)]
Batch: [118/299 (39%)]
Batch: [119/299 (40%)]
Batch: [120/299 (40%)]
Batch: [121/299 (40%)]
Batch: [122/299 (41%)]
Batch: [123/299 (41%)]
Batch: [124/299 (41%)]
Batch: [125/299 (42%)]
Batch: [126/299 (42%)]
Batch: [127/299 (42%)]
Batch: [128/299 (43%)]
Batch: [129/299 (43%)]
Batch: [130/299 (43%)]
Batch: [131/299 (44%)]
Batch: [132/299 (44%)]
Batch: [133/299 (44%)]
Batch: [134/299 (45%)]
Batch: [135/299 (45%)]
Batch: [136/299 (45%)]
Batch: [137/299 (46%)]
Batch: [138/299 (46%)]
Batch: [139/299 (46%)]
Batch: [140/299 (47%)]
Batch: [141/299 (47%)]
Batch: [142/299 (47%)]
Batch: [143/299 (48%)]
Batch: [144/299 (48%)]
Batch: [145/299 (48%)]
Batch: [146/299 (49%)]
Batch: [147/299 (49%)]
Batch: [148/299 (49%)]
Batch: [149/299 (50%)]
Batch: [150/299 (50%)]
Batch: [151/299 (51%)]
Batch: [152/299 (51%)]
Batch: [153/299 (51%)]
Batch: [154/299 (52%)]
Batch: [155/299 (52%)]
Batch: [156/299 (52%)]
Batch: [157/299 (53%)]
Batch: [158/299 (53%)]
Batch: [159/299 (53%)]
Batch: [160/299 (54%)]
Batch: [161/299 (54%)]
Batch: [162/299 (54%)]
Batch: [163/299 (55%)]
Batch: [164/299 (55%)]
Batch: [165/299 (55%)]
Batch: [166/299 (56%)]
Batch: [167/299 (56%)]
Batch: [168/299 (56%)]
Batch: [169/299 (57%)]
Batch: [170/299 (57%)]
Batch: [171/299 (57%)]
Batch: [172/299 (58%)]
Batch: [173/299 (58%)]
Batch: [174/299 (58%)]
Batch: [175/299 (59%)]
Batch: [176/299 (59%)]
Batch: [177/299 (59%)]
Batch: [178/299 (60%)]
Batch: [179/299 (60%)]
Batch: [180/299 (60%)]
Batch: [181/299 (61%)]
Batch: [182/299 (61%)]
Batch: [183/299 (61%)]
Batch: [184/299 (62%)]
Batch: [185/299 (62%)]
Batch: [186/299 (62%)]
Batch: [187/299 (63%)]
Batch: [188/299 (63%)]
Batch: [189/299 (63%)]
Batch: [190/299 (64%)]
Batch: [191/299 (64%)]
Batch: [192/299 (64%)]
Batch: [193/299 (65%)]
Batch: [194/299 (65%)]
Batch: [195/299 (65%)]
Batch: [196/299 (66%)]
Batch: [197/299 (66%)]
Batch: [198/299 (66%)]
Batch: [199/299 (67%)]
Batch: [200/299 (67%)]
Batch: [201/299 (67%)]
Batch: [202/299 (68%)]
Batch: [203/299 (68%)]
Batch: [204/299 (68%)]
Batch: [205/299 (69%)]
Batch: [206/299 (69%)]
Batch: [207/299 (69%)]
Batch: [208/299 (70%)]
Batch: [209/299 (70%)]
Batch: [210/299 (70%)]
Batch: [211/299 (71%)]
Batch: [212/299 (71%)]
Batch: [213/299 (71%)]
Batch: [214/299 (72%)]
Batch: [215/299 (72%)]
Batch: [216/299 (72%)]
Batch: [217/299 (73%)]
Batch: [218/299 (73%)]
Batch: [219/299 (73%)]
Batch: [220/299 (74%)]
Batch: [221/299 (74%)]
Batch: [222/299 (74%)]
Batch: [223/299 (75%)]
Batch: [224/299 (75%)]
Batch: [225/299 (75%)]
Batch: [226/299 (76%)]
Batch: [227/299 (76%)]
Batch: [228/299 (76%)]
Batch: [229/299 (77%)]
Batch: [230/299 (77%)]
Batch: [231/299 (77%)]
Batch: [232/299 (78%)]
Batch: [233/299 (78%)]
Batch: [234/299 (78%)]
Batch: [235/299 (79%)]
Batch: [236/299 (79%)]
Batch: [237/299 (79%)]
Batch: [238/299 (80%)]
Batch: [239/299 (80%)]
Batch: [240/299 (80%)]
Batch: [241/299 (81%)]
Batch: [242/299 (81%)]
Batch: [243/299 (81%)]
Batch: [244/299 (82%)]
Batch: [245/299 (82%)]
Batch: [246/299 (82%)]
Batch: [247/299 (83%)]
Batch: [248/299 (83%)]
Batch: [249/299 (83%)]
Batch: [250/299 (84%)]
Batch: [251/299 (84%)]
Batch: [252/299 (84%)]
Batch: [253/299 (85%)]
Batch: [254/299 (85%)]
Batch: [255/299 (85%)]
Batch: [256/299 (86%)]
Batch: [257/299 (86%)]
Batch: [258/299 (86%)]
Batch: [259/299 (87%)]
Batch: [260/299 (87%)]
Batch: [261/299 (87%)]
Batch: [262/299 (88%)]
Batch: [263/299 (88%)]
Batch: [264/299 (88%)]
Batch: [265/299 (89%)]
Batch: [266/299 (89%)]
Batch: [267/299 (89%)]
Batch: [268/299 (90%)]
Batch: [269/299 (90%)]
Batch: [270/299 (90%)]
Batch: [271/299 (91%)]
Batch: [272/299 (91%)]
Batch: [273/299 (91%)]
Batch: [274/299 (92%)]
Batch: [275/299 (92%)]
Batch: [276/299 (92%)]
Batch: [277/299 (93%)]
Batch: [278/299 (93%)]
Batch: [279/299 (93%)]
Batch: [280/299 (94%)]
Batch: [281/299 (94%)]
Batch: [282/299 (94%)]
Batch: [283/299 (95%)]
Batch: [284/299 (95%)]
Batch: [285/299 (95%)]
Batch: [286/299 (96%)]
Batch: [287/299 (96%)]
Batch: [288/299 (96%)]
Batch: [289/299 (97%)]
Batch: [290/299 (97%)]
Batch: [291/299 (97%)]
Batch: [292/299 (98%)]
Batch: [293/299 (98%)]
Batch: [294/299 (98%)]
Batch: [295/299 (99%)]
Batch: [296/299 (99%)]
Batch: [297/299 (99%)]
Batch: [298/299 (100%)]
Total: 299
Valid: 299
PCK: 78.89%
But no folder of output matches
was created, for subsequent processing by the Matlab InLoc program.
Hi, the matches folder is for the InLoc evaluation. In this case you are running the PF Pascal evaluation, the PCK result is shown in the last line of the output.