ctransformers icon indicating copy to clipboard operation
ctransformers copied to clipboard
verified publisher icon marella

Mistral Sliding Window Attention (SWA)

Open stygmate opened this issue 2 years ago • 1 comments

Does ctransformers support Sliding Window Attention (SWA) ?

stygmate avatar Nov 23 '23 17:11 stygmate

Mistral works with ctransformer - I tested v0.2 ...

ollie2a avatar Dec 21 '23 13:12 ollie2a