llm.c icon indicating copy to clipboard operation
llm.c copied to clipboard

Published 20 hours ago • verified publisher icon karpathy

ThunderKittens Backend

Open AndreSlavescu opened this issue 9 months ago • 1 comments

Would it be an idea to define the same kernels that exist in the CUDA backend with ThunderKittens as well? They have cool examples with FlashAttention2 and I think it would be interesting to have as an educational resource as well. Thoughts?

AndreSlavescu avatar May 13 '24 22:05 AndreSlavescu