optimum-habana icon indicating copy to clipboard operation
optimum-habana copied to clipboard

use fast softmax only on prefill

Open jaygala223 opened this issue 7 months ago • 2 comments

use fast softmax only on prefill

jaygala223 avatar Jul 25 '24 09:07 jaygala223