triton icon indicating copy to clipboard operation
triton copied to clipboard

Published 20 hours ago • verified publisher icon triton-lang

[TUTORIAL] Minor update and clean up the tutorial05

Open lancerts opened this issue 9 months ago • 0 comments

  1. Based on the formula and the actual computation code, the B and eps are not used in def _layer_norm_bwd_dx_fused and are thus removed for clarity.
  2. Some other minor clean-ups.

Changes have tested on GPU, execution parity.

lancerts avatar May 23 '24 04:05 lancerts