composable_kernel

composable_kernel copied to clipboard

bartekxk

[BUG]: when enable arg.print() got print errors

1

### Problem Description to debug `02_gemm_add_add_fastgelu` with client api, I tried to enable arg.Print() under Invoker:;Run() as following: ```c++ // Invoker struct Invoker : public BaseInvoker { using Argument =...

ZJLi2013

[CK_TILE] Add appendkv kernel to support mha with kvcache

1

Add new `fmha_fwd_appendkv()` API which runs ahead the `fmha_fwd()`/`fmha_fwd_splitkv()` API. The `fmha_fwd_appendkv()` + `fmha_fwd()`/`fmha_fwd_splitkv()` combination implement the functionality of `mha_fwd_kvcache()` in FA 2.5 (without paged-kvcache part)

poyenc

This will reduce the size of binaries built with compilers ROCm6.2+ by at least 50%.

illsilin

This will help prevent CI pipeline crashes due to nodes running out of disc space.

illsilin

Added structural sparsity blockwise gemm

jakpiase

danyao12

[CK_TILE] Pick bugfixes for ROCm 6.2 compiler issues

3

poyenc

Enabled bf16 atomic_add on MI300

zjing14

adding mha as static lib

2

* This PR is to generate the mha static lib from generate.py

bghimireamd