Vary-toy icon indicating copy to clipboard operation
Vary-toy copied to clipboard

Published 20 hours ago • verified publisher icon Ucas-HaoranWei

支持 4/8 bit 量化运行

Open yazheng0307 opened this issue 1 year ago • 1 comments

感谢作者团队的开源工作！ 请问Vary-toy的demo是否支持支持 4/8 bit 量化运行

yazheng0307 avatar Jan 25 '24 02:01 yazheng0307

线上demo是fp16运行的，目前还未支持4/8量化

Ucas-HaoranWei avatar Jan 25 '24 02:01 Ucas-HaoranWei