Add support for flash attention with use_cache

Open DachengLi1 opened this issue 2 years ago • 1 comments

Jun 30 '23 09:06 DachengLi1

thanks for your guys' amazing work ! i want know is this issue associate with vLLM ?

Aug 10 '23 09:08 Zhuqln