inference icon indicating copy to clipboard operation
inference copied to clipboard

ENH: accelerate pytorch model generate stream

Open pangyoki opened this issue 1 year ago • 1 comments

optimize tokenizer.decode method

pangyoki avatar Aug 02 '23 06:08 pangyoki

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] avatar Aug 11 '24 19:08 github-actions[bot]

This issue was closed because it has been inactive for 5 days since being marked as stale.

github-actions[bot] avatar Aug 17 '24 19:08 github-actions[bot]