executorch
executorch copied to clipboard
pytorch
[llava][18/N] Move token generation loop to a class
Stack from ghstack (oldest at bottom):
- -> #4652
As titled. This PR moves the token generation loop in llama2 runner into a new class so it can be reused.
Differential Revision: D61047601
:link: Helpful Links
:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/4652
- :page_facing_up: Preview Python docs built from this PR
Note: Links to docs will display an error until the docs builds have been completed.
:x: 1 Cancelled Job, 3 Unrelated Failures
As of commit 0bda164cdb597f713f70c9c7fa82c2bef4427444 with merge base e71fa03091149ecaffc13fb8a67dfd2776ecc0f4 (
CANCELLED JOB - The following job was cancelled. Please retry:
- trunk / test-llama-runner-mac (fp32, cmake, xnnpack+kv+custom) / macos-job (gh)
##[error]The operation was canceled.
FLAKY - The following job failed but was likely due to flakiness present on trunk:
- trunk / test-llama-runner-mac (fp32, buck2, coreml) / macos-job (gh) (matched macos rule in flaky-rules.json)
File doesn't exist
UNSTABLE - The following jobs failed but were likely due to flakiness present on trunk and has been marked as unstable:
- Build Linux Wheels / pytorch/executorch / upload / manywheel-py3_9-cpu (gh) (#4308)
- Build M1 Wheels / pytorch/executorch / upload / wheel-py3_9-cpu (gh) (#4309)
Unable to find any artifacts for the associated workflow
This comment was automatically generated by Dr. CI and updates every 15 minutes.
![pytorch-bot[bot] avatar](https://avatars.githubusercontent.com/in/40112?v=4 "Published by a pub.dev verified publisher"){kind=small}
@larryliu0820 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.
@larryliu0820 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.
@larryliu0820 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.
@larryliu0820 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.
@larryliu0820 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.