pytorch icon indicating copy to clipboard operation
pytorch copied to clipboard

[ROCm] Eliminate the need for divisions in layernorm for default vector size.

Open doru1004 opened this issue 11 months ago • 11 comments

This fixes the precision error observed in the CI for layernorm and completely eliminates the need for doing any divisions when vector size is 4 i.e. the default vector size.

doru1004 avatar Jan 22 '25 17:01 doru1004

Jenkins build for 87ba9faa05f751dc617b9d6e0b0fed7a8238f603 commit finished as FAILURE Links: Blue Ocean view / Build artifacts

Jenkins build for 469f8c0cb41cf248966765b7a7535e317f4004f8 commit finished as FAILURE Links: Blue Ocean view / Build artifacts

Jenkins build for 469f8c0cb41cf248966765b7a7535e317f4004f8 commit finished as FAILURE Links: Blue Ocean view / Build artifacts

Jenkins build for 469f8c0cb41cf248966765b7a7535e317f4004f8 commit finished as FAILURE Links: Blue Ocean view / Build artifacts

Jenkins build for 469f8c0cb41cf248966765b7a7535e317f4004f8 commit finished as FAILURE Links: Blue Ocean view / Build artifacts

Jenkins build for 469f8c0cb41cf248966765b7a7535e317f4004f8 commit finished as ABORTED Links: Blue Ocean view / Build artifacts

Jenkins build for 469f8c0cb41cf248966765b7a7535e317f4004f8 commit finished as FAILURE Links: Blue Ocean view / Build artifacts

Jenkins build for 469f8c0cb41cf248966765b7a7535e317f4004f8 commit finished as FAILURE Links: Blue Ocean view / Build artifacts

Jenkins build for 469f8c0cb41cf248966765b7a7535e317f4004f8 commit finished as FAILURE Links: Blue Ocean view / Build artifacts

Jenkins build for 469f8c0cb41cf248966765b7a7535e317f4004f8 commit finished as FAILURE Links: Blue Ocean view / Build artifacts

Jenkins build for 469f8c0cb41cf248966765b7a7535e317f4004f8 commit is in progress Links: Blue Ocean view / Build artifacts