fairseq icon indicating copy to clipboard operation
fairseq copied to clipboard

Update get_available_activation_fns to match get_activation_fn

Open DavidMChan opened this issue 1 year ago • 0 comments

Before submitting

  • [x] Was this discussed/approved via a Github issue? (no need for typos, doc improvements)
  • [x] Did you read the contributor guideline?
  • [x] Did you make sure to update the docs?
  • [x] Did you write any new necessary tests?

What does this PR do?

Fixes a discrepancy between the get_activation_fn() method and the get_available_activation_fns() method (enabling "swish" and "relu_squared" as available).

PR review

Anyone in the community is free to review the PR once the tests have passed. If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

DavidMChan avatar Nov 16 '22 17:11 DavidMChan