Bruce-Lee-LY
Results
5
repositories owned by
Bruce-Lee-LY
cuda_hgemm
270
Stars
62
Forks
Watchers
Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.
cuda_hook
129
Stars
33
Forks
Watchers
Hooked CUDA-related dynamic libraries by using automated code generation tools.
cuda_hgemv
48
Stars
4
Forks
Watchers
Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.
flash_attention_inference
20
Stars
2
Forks
Watchers
Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
decoding_attention
17
Stars
1
Forks
Watchers
Decoding Attention is specially optimized for multi head attention (MHA) using CUDA core for the decoding stage of LLM inference.