FeiyangChen issues

Repositories
Issues
Comments

Results 2 issues of


                                            FeiyangChen

Add support for qk hidden dim different from v hidden dim

We add support for - different hidden dimension between qk and v. - not equal num_heads_k and num_heads_v, such as (num_heads_q, num_heads_k, num_heads_v) = (32, 4, 16). For different hidden...

[Feature Request] Support inputs to be a list of tensors

How do I implement a kernel with the arguments a list of tensors? When implementing the grouped gemm kernel, I want the weight input to be a list of tensors....

enhancement