Flash-Attention-Softmax-N icon indicating copy to clipboard operation
Flash-Attention-Softmax-N copied to clipboard
verified publisher icon softmax1

added unit tests for `attn_mask`

Open christopher-w-murphy opened this issue 1 year ago • 0 comments

I added unit tests for the case when the attn_mask arugment of flash_attention_n or slow_attention_n is not None in an attempt to reproduce #39. My unit tests pass on my personal machine (cpu).

christopher-w-murphy avatar May 26 '24 22:05 christopher-w-murphy