massive-activations icon indicating copy to clipboard operation
massive-activations copied to clipboard

Published 20 hours ago • verified publisher icon locuslab

How to get the mean value of massive activation

Open pengyao96 opened this issue 11 months ago • 1 comments

  1. How to get the mean value of massive activation？e.g. 2546.8/-1502.0 in hook.py
  2. Mean value is still large, what is the difference between using the mean value and using the original value?

pengyao96 avatar Mar 05 '24 08:03 pengyao96