open-sesame icon indicating copy to clipboard operation
open-sesame copied to clipboard

Published 20 hours ago • verified publisher icon swabhs

Question on the reported results.

Open waltbai opened this issue 4 years ago • 1 comments

Is the reported frameid result (89.74 on dev and 86.55 on test) using the gold target labels? And what's the frameid result if targetid module is used instead of gold target labels?

waltbai avatar Nov 29 '20 18:11 waltbai

It seems that frameid is trained and evaluated only on sentences which have frames, and the sentences which have no frame are ignored. This result seems not be able to reflect the performance on sentences which we do not know whether there exist frames?

waltbai avatar Dec 02 '20 16:12 waltbai