Yu Zhang

@uniartisan Can you see msgs in your notice box

@uniartisan sure, sorry for my late reply

@uniartisan Can you see my updated comments between the lines?

@uniartisan Thank you for the update. I'm running your code locally as there is no CI w/ GPUs. Will sync with you recently.

@uniartisan Hi, can you authorize this branch to me so that I can make some updates

@uniartisan Hi, closing this PR as new features are too coupled. @sustcsonglin just pushed some new commits resolving the RWKV6 precision problems. Checkout those for more details. You can create...

@juankost Hi, could you report your torch & triton version, I met some errors when running your code snippets.

Hi, mine is torch 2.3 & triton 2.3 ```sh TypeError: launcher() got an unexpected keyword argument 'num_warps' ``` not sure what exactly happened. Just provide a quick fix, could you...

@juankost Here is my current output with torch2.4 and triton3.0 ``` Testing torc compile for dtype torch.float16 Compiled vs non compiled Pytorch Outputs match -------------------------------------------------------------------------------- Triton (non compiled) vs Pytorch...

I’m just using the above code. If still failing, we might consider other solutions for this issue