Abhinav

icon indicating a website link https://abhinav.at icon indicating an email [email protected]

icon location localhost:8000 icon location ML Dev | It's all about trying

Results 7 comments of Abhinav

Failed to apply Splash kernel for flash attention.

Hi @telecomadm1145 How are you able to run this code on kaggle , can you tell ? i am constantly getting hit with resource exhaustion which seems like a HBM...

Failed to apply Splash kernel for flash attention.

@telecomadm1145 lol , i literally forgot Thanks man 🫡

Failed to apply Splash kernel for flash attention.

Hi @telecomadm1145 I analysed the whole problem and this is what i came up with When i was using dot_product_attention with a mask inside a JAX while_loop on TPU, the...

Add Standalone Mixture of Experts example

/gemini review

Add Standalone Mixture of Experts example

/gemini review

Add Standalone Mixture of Experts example

/gemini review

Add Standalone Mixture of Experts example

/gemini review