executorch icon indicating copy to clipboard operation
executorch copied to clipboard

log_softmax

Open copyrightly opened this issue 9 months ago • 6 comments

Summary: Use the following property to implement log_softmax

log(exp(x_i) / sum(exp(x_j))) = x_i - log(sum(exp(x_j)))
  • numerically stable, since we can avoid log(small_number) -> -\infty
  • reusing existing softmax shader to generate variants

Differential Revision: D56688093

copyrightly avatar Apr 29 '24 22:04 copyrightly

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/3411

Note: Links to docs will display an error until the docs builds have been completed.

:x: 2 New Failures

As of commit 5de743fa3bbd066d4d55ecd947ad687a6134fc25 with merge base 2c1e2836e321d9205eeb7662ffcfe51aaece6f98 (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

pytorch-bot[bot] avatar Apr 29 '24 22:04 pytorch-bot[bot]

This pull request was exported from Phabricator. Differential Revision: D56688093

facebook-github-bot avatar May 07 '24 16:05 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D56688093

facebook-github-bot avatar May 07 '24 16:05 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D56688093

facebook-github-bot avatar May 07 '24 17:05 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D56688093

facebook-github-bot avatar May 07 '24 23:05 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D56688093

facebook-github-bot avatar May 07 '24 23:05 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D56688093

facebook-github-bot avatar May 08 '24 02:05 facebook-github-bot

This pull request has been merged in pytorch/executorch@5b65163c37f77cd98073783745396dae847864d7.

facebook-github-bot avatar May 08 '24 02:05 facebook-github-bot