LISA
LISA copied to clipboard
eval the model with golden parsing
I am wondering if there is a place to config the eval with the golden parsing?
Sure, in parse_attention.json if you change:
"eval_attention_to_copy": {
"layer": "parse_head",
"output": "scores"
}
to:
"eval_attention_to_copy": {
"label": "parse_head"
}
that should evaluate using the gold parse head labels.