triton icon indicating copy to clipboard operation
triton copied to clipboard

Published 20 hours ago • verified publisher icon triton-lang

Can Triton support split-k matrix multiplication

Open zhoutianzi666 opened this issue 1 year ago • 2 comments

Can Triton support split-k matrix multiplication?

zhoutianzi666 avatar Jan 10 '24 05:01 zhoutianzi666

The provided triton.ops.matmul appears to do so: https://github.com/openai/triton/blob/main/python/triton/ops/matmul.py#L96

bertmaher avatar Jan 10 '24 16:01 bertmaher

The provided triton.ops.matmul appears to do so: https://github.com/openai/triton/blob/main/python/triton/ops/matmul.py#L96

3Q

zhoutianzi666 avatar Jan 11 '24 15:01 zhoutianzi666

hi, have you try this? I try this but find it produce result with too large errors.

sleepwalker2017 avatar Jul 10 '24 13:07 sleepwalker2017