Baichuan2 icon indicating copy to clipboard operation
Baichuan2 copied to clipboard

Published 20 hours ago • verified publisher icon baichuan-inc

8bit量化完后做推理的时候是不是要做反量化用FP16计算？

Open huanyingjun opened this issue 1 year ago • 1 comments

RT

huanyingjun avatar Dec 13 '23 03:12 huanyingjun

是的

baichuan-assistant avatar Dec 26 '23 08:12 baichuan-assistant