EmbedKGQA icon indicating copy to clipboard operation
EmbedKGQA copied to clipboard

Published 20 hours ago • verified publisher icon malllabiisc

webqsp half

Open yaowang1112 opened this issue 3 years ago • 4 comments

Do we need relation matching for webqsp half ?

yaowang1112 avatar Mar 24 '21 12:03 yaowang1112

No, it is not needed. Please refer Table 5 in the paper for the ablation study that shows that performance decreases when doing relation matching for half KG.

apoorvumang avatar Mar 24 '21 13:03 apoorvumang

The accuracy I got on webqsp half was 0.478. May I know how you got 53.2% accuracy? @apoorvumang

Validation accuracy decreases to 0.468394 from 0.478508, 0 more epoch to check

lihuiliullh avatar Dec 01 '21 00:12 lihuiliullh

@lihuiliullh did you re-train the KG embeddings or use the pretrained checkpoint?

apoorvumang avatar Dec 01 '21 04:12 apoorvumang

I just downloaded the code and ran it following the instruction. @apoorvumang

image

lihuiliullh avatar Dec 01 '21 16:12 lihuiliullh