LISA icon indicating copy to clipboard operation
LISA copied to clipboard

eval the model with golden parsing

Open GaryYufei opened this issue 6 years ago • 1 comments

I am wondering if there is a place to config the eval with the golden parsing?

GaryYufei avatar Oct 12 '18 03:10 GaryYufei

Sure, in parse_attention.json if you change:

"eval_attention_to_copy": {
    "layer": "parse_head",
    "output": "scores"
}

to:

"eval_attention_to_copy": {
    "label": "parse_head"
}

that should evaluate using the gold parse head labels.

strubell avatar Oct 28 '18 17:10 strubell