yoyodyne icon indicating copy to clipboard operation
yoyodyne copied to clipboard

Published 20 hours ago • verified publisher icon CUNY-CL

Hard monotonic

Open bonham79 opened this issue 9 months ago • 2 comments

Wu and Coterrell's hard monotonic transduce..

Closes https://github.com/CUNY-CL/yoyodyne/issues/165.

It builds off lstm module. To call you pass hmm_lstm for --arch. Hard monotonic constrain is enforced with --enable_monotonic while context window is enabled with --hmm_context.

While y'all are merging, could you take a peek at how attention and log_prob contexts are preserved? I hate having that large a tensor filling up memory but when I try to be clever about it it causes model collapse.

bonham79 avatar May 07 '24 05:05 bonham79