torchtune icon indicating copy to clipboard operation
torchtune copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

Implement quantized model inference for `generate_v2`

Open SalmanMohammadi opened this issue 4 months ago • 0 comments

We'll probably also need #1782.

SalmanMohammadi avatar Oct 11 '24 15:10 SalmanMohammadi