llm.c icon indicating copy to clipboard operation
llm.c copied to clipboard

Published 20 hours ago • verified publisher icon karpathy

layernorm_backward.cu: atomicAdd

Open azret opened this issue 10 months ago • 0 comments

https://github.com/karpathy/llm.c/blob/7b79fbb230fd78bd96684b0a8728a3951d66c940/dev/cuda/layernorm_backward.cu#L208

Should all of these use atomicAdd?

azret avatar Apr 20 '24 01:04 azret