doodle2search icon indicating copy to clipboard operation
doodle2search copied to clipboard

can't reproduce accurate MAP

Open buptlmk opened this issue 5 years ago • 7 comments

Respected Authors, Your paper is great. I have two question to ask you.
The first one is that after training on Sketchy-Extend dataset, I can't reproduce your result. Your mAP result is 0.3691 in the paper, but I only got 0.0589. Can you publish your pretrained model? The second one is I can't produce sketchy_semantic_label by word2Vec, it told me "word 'XXX' is not in vocabulary"。Can you help me deal with this problem? Thank you!

buptlmk avatar Nov 18 '19 14:11 buptlmk

(1) I got 0.058 map reproduced, too. (2) I think the word xxx should be seperated, for example, car_(sedan)

haowang1992 avatar Nov 28 '19 09:11 haowang1992

I got 0.363 map, but I use the semantic_label released by the author.

payne53 avatar Dec 11 '19 02:12 payne53

@payne53 Thank you so much for pointing it. Could you reproduce the performance on QuickDraw dataset?

haowang1992 avatar Dec 11 '19 09:12 haowang1992

@payne53 Thank you so much for pointing it. Could you reproduce the performance on QuickDraw dataset?

Sorry, I haven't tried QuickDraw yet.

payne53 avatar Dec 13 '19 07:12 payne53

how did you guys get this running? I kept getting TypeError: 'int' object is not iterable errors after Preparing Data.

dlai6620 avatar Feb 25 '20 07:02 dlai6620

I got 0.363 map, but I use the semantic_label released by the author.

Hi. Have you made any changes to the code?I just got 0.3294 map.I have not made changes to this code

develop-productivity avatar Jul 28 '22 12:07 develop-productivity

您好~我已经收到您的邮件,我会尽快查看,祝生活愉快~

buptlmk avatar Oct 11 '22 07:10 buptlmk