sacremoses icon indicating copy to clipboard operation
sacremoses copied to clipboard

Published 20 hours ago • verified publisher icon hplt-project

No detokenize_penn?

Open mfelice opened this issue 3 years ago • 0 comments

Hi there,

Moses has a detokenize_penn() method in Perl but I can't find it here. This means that things like wo n't or ca n't can't be detokenised. Any chance to get this behaviour with sacremoses?

Thanks!

mfelice avatar Apr 18 '21 21:04 mfelice