tensor-core topic
List
tensor-core repositories
trafficstars
cuda_hgemm
270
Stars
62
Forks
Watchers
Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.
cuda_hgemv
48
Stars
4
Forks
Watchers
Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.
flash_attention_inference
20
Stars
2
Forks
Watchers
Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.