EasyDeL icon indicating copy to clipboard operation
EasyDeL copied to clipboard
verified publisher icon erfanzar

feat: add relu_squared activation function and corresponding tests

Open opooladz opened this issue 8 months ago • 0 comments

  • Introduced relu_squared activation function to the ACT2FN dictionary in easydel/infra/utils.py.
  • Added unit tests for relu_squared and existing activation functions in a new test file tests/test_activations.py.
  • Updated CHANGELOG to reflect the new activation function.

opooladz avatar Apr 24 '25 05:04 opooladz