triton-transformer icon indicating copy to clipboard operation
triton-transformer copied to clipboard

Published 20 hours ago • verified publisher icon lucidrains

Current state of benchmarking & contributing?

Open siddk opened this issue 2 years ago • 0 comments

Hey @lucidrains - hope you're doing well! I have some time to hack the next couple weeks, just wanted to get a sense of:

  • Current state of benchmarking (what Triton kernels provide how much lift, aggregate lift over a "vanilla Transformer implementation"
  • If there's anything I could help with, especially as I learn Triton!

siddk avatar Apr 14 '22 14:04 siddk