gpt-fast icon indicating copy to clipboard operation
gpt-fast copied to clipboard

flex_attention ver.

Open joydddd opened this issue 1 year ago • 2 comments

Implement gpt-fast using flex_attention HOP.

replies on this PR: https://github.com/pytorch/pytorch/pull/132157

joydddd avatar Jul 30 '24 22:07 joydddd