flash_attention_inference icon indicating copy to clipboard operation
flash_attention_inference copied to clipboard

Published 20 hours ago • verified publisher icon Bruce-Lee-LY
→

Metadata

Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.

Results 0 flash_attention_inference issues
Sort by recently updated
recently updated
newest added

← Metadata

20
Stars
2
Forks
Watchers

Owner

verified publisher icon Bruce-Lee-LY

Metadata

Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.

Back