ecco
ecco copied to clipboard
Support for Constrained Beam Search?
Hola! Great project, thank you for making it available!
I am curious now that beam search is supported, is it possible to pass constraints to ecco using for example PhrasalConstraints, to constrain T5 model output for a sequence-to-sequence task prior to ecco evaluation?
Thanks in advance!
I am curious now that beam search is supported, is it possible to pass constraints to ecco using for example PhrasalConstraints, to constrain T5 model output for a sequence-to-sequence task prior to ecco evaluation?
It is! If you look in here, LM.generate
accepts any extra argument as an argument to pass to model.generate
Just pass your logit constraints in there!