Triton-Puzzles
Triton-Puzzles copied to clipboard
srush
Puzzles for learning Triton
I have received the following warning twice when running in Google Colab free tier, and am wary of continuing to run the Triton Puzzles notebook because of it: (I don't...
I don't really understand the visualizations tbh, so I wanted to turn them off, but viz=False, leads to the following error: ``` --------------------------------------------------------------------------- UnboundLocalError Traceback (most recent call last) [](https://ucrqhfq45wo-496ff2e9c6d22116-0-colab.googleusercontent.com/outputframe.html?vrz=colab_20240403-060136_RC00_621473488#)...
I solve the long softmax puzzels, but I have to store the intermediate results to z_ptr, which may cause unnecessary Memory I/O. Essentially, I would like to know if there's...
@srush Always appreciate your wonderful OSS educational contributions! I'm relatively familiar with `CUDA` and `triton` but less so with machine learning compilers and am interested in getting into the weeds...
The notation for the softmax in Puzzle 9 is confusing. The current indexing is not representative of the outer product, and also the inclusion of an extra variable B1 is...
By directly running on colab, I saw this error ``` ImportError: cannot import name 'interpreter_builder' from 'triton.runtime.interpreter' ``` by inspecting the import with `dir(triton.runtime.interpreter)`, there seems no `interpreter_builder` ``` ['BlockPointerHandle',...
Great work and thanks for providing this learning material! I am wondering where we can get the answers to the puzzles? Best.
Running the Gradio visualizations on Colab, and remote Jupyterlab outputs not working plot. This happens with all vis. 
