executorch icon indicating copy to clipboard operation
executorch copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

[llava][18/N] Move token generation loop to a class

Open larryliu0820 opened this issue 6 months ago • 2 comments

Stack from ghstack (oldest at bottom):

  • -> #4652

As titled. This PR moves the token generation loop in llama2 runner into a new class so it can be reused.

Differential Revision: D61047601

larryliu0820 avatar Aug 09 '24 21:08 larryliu0820