xla icon indicating copy to clipboard operation
xla copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

Add blockwise quantized dot support

Open lsy323 opened this issue 7 months ago • 0 comments

Add blockwise quantized dot support for 8-bit and 4-bit weight

Test:

  • Added unit tests

lsy323 avatar Jul 02 '24 06:07 lsy323