triton icon indicating copy to clipboard operation
triton copied to clipboard

Published 20 hours ago • verified publisher icon triton-lang

[FRONTEND] Reduce kernel launch overhead using type hints

Open ptillet opened this issue 2 years ago • 5 comments

ptillet avatar Feb 23 '23 03:02 ptillet

Hey, any news regarding this issue please? :-)

Do you feel confidence that at some point we will be able to write cuda kernels (with Triton) without having a huge bottleneck because of the cpu overhead (cc: #416)? Thanks!

Adel-Moumen avatar Mar 27 '23 10:03 Adel-Moumen

I wonder what we can do currently for a temporal fix? E.g. where to add type hints? thanks.

Akimoto-Cris avatar Jun 12 '23 05:06 Akimoto-Cris

running into the same issue

could we have any temp fixes now?

void-main avatar Nov 10 '23 02:11 void-main

@Adel-Moumen @Akimoto-Cris @void-main Been working on some tools for kernel compilation directly from jitted functions.

Happy to tailor these tools for your use case.

jeromeku avatar Nov 12 '23 07:11 jeromeku

@jeromeku: I am interesting in testing the tools that you have created. How do I get in touch with you?

jpilaul avatar Apr 11 '24 13:04 jpilaul