ao icon indicating copy to clipboard operation
ao copied to clipboard
verified publisher icon pytorch

Unify llama generate utils

Open guangyey opened this issue 1 month ago • 3 comments

Motivation

Unify llama generate utils via torch.accelerator APIs.

cc @albanD

guangyey avatar Nov 10 '25 06:11 guangyey

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/3318

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

pytorch-bot[bot] avatar Nov 10 '25 06:11 pytorch-bot[bot]

@pytorchbot label "topic: improvement"

guangyey avatar Nov 18 '25 07:11 guangyey

The CI workflow needs to be triggered.

guangyey avatar Nov 18 '25 07:11 guangyey

@jerryzh168 I rebase this PR to the latest main already. Could you help re-trigger the CI.

guangyey avatar Dec 19 '25 03:12 guangyey