smoothquant icon indicating copy to clipboard operation
smoothquant copied to clipboard

Published 20 hours ago • verified publisher icon mit-han-lab

What is the difference between `get_act_scales` and `get_static_decoder_layer_scales`

Open CaffreyR opened this issue 2 years ago • 1 comments

Hi, many thanks for your excellent work. I have little question about the calibration.py. What is the difference between get_act_scales and get_static_decoder_layer_scales? Thank you very much

CaffreyR avatar Feb 08 '23 16:02 CaffreyR

@CaffreyR get_act_scales to smooth act and weight get_static_decoder_layer_scales to quantize act and weight

lippman1125 avatar Mar 14 '23 07:03 lippman1125