keras-nlp icon indicating copy to clipboard operation
keras-nlp copied to clipboard
verified publisher icon keras-team

Decoding Functions Not Working when `jit_compile = True`

Open abheesht17 opened this issue 3 years ago • 2 comments

When jit_compile is set to True, the decoding functions do not work. We wish to add support for the same in the future.

Error: https://p.ip.fi/2TNt

abheesht17 avatar Jul 22 '22 17:07 abheesht17

Thanks for opening!

mattdangerw avatar Jul 22 '22 21:07 mattdangerw

Once you pushed the new version, we may want to test on TPU as well. I will add some tests.

chenmoneygithub avatar Jul 23 '22 03:07 chenmoneygithub

This is mostly done, we just need some changes for beam search @abheesht17 is currently working on. Once beam search gains support, we can close this.

mattdangerw avatar Sep 02 '22 19:09 mattdangerw