torchchat icon indicating copy to clipboard operation
torchchat copied to clipboard

[Feature request] Eager mode support for a8w4dq

Open mikekgfb opened this issue 10 months ago • 4 comments

https://github.com/pytorch/torchchat/edit/main/docs/quantization.md

Does a8w4dq also work for eager mode generate for testing before export without Executorch?

cc: @digantdesai @kimishpatel

mikekgfb avatar Apr 21 '24 08:04 mikekgfb