DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Allow FixedSparseAttention with num_global_blocks = 0

Open sdtblck opened this issue 4 years ago • 1 comments

To simulate naive local attention

sdtblck avatar May 01 '21 14:05 sdtblck

Can one of the admins verify this patch?

rocm-mici avatar Jun 09 '22 20:06 rocm-mici

Closing this PR as it appears to be stale and out of date - if this is still useful, please re-open or create a new PR. Thanks!

loadams avatar Aug 29 '23 20:08 loadams