open_lm icon indicating copy to clipboard operation
open_lm copied to clipboard
verified publisher icon mlfoundations

Fused RMSNorm

Open sagadre opened this issue 2 years ago • 2 comments

Adding triton kernel for rms norm and testing

sagadre avatar Oct 18 '23 16:10 sagadre

#3

sagadre avatar Oct 18 '23 16:10 sagadre

Next step is to test this on multinode, I'll look into this after Nov 17

achalddave avatar Nov 10 '23 17:11 achalddave