SnapKV icon indicating copy to clipboard operation
SnapKV copied to clipboard

add snapKV implementation for transformers sdpa attention with flash_attn availability checking

Open Clement25 opened this issue 5 months ago • 0 comments

In the case that flash_attn_2 is not available.

Currently only add hijiack_llama, will add implementations for other models in a later time.

Clement25 avatar Aug 09 '25 09:08 Clement25