DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Explicitly check for OPT activation function

Open cmikeh2 opened this issue 1 year ago • 0 comments

When a HF config is available, this PR changes the OPT policy to explicitly check for the activation function used. This bug was reported in https://github.com/microsoft/DeepSpeed/issues/3263.

cmikeh2 avatar Apr 17 '23 23:04 cmikeh2