Xformers Monkey Patch Compatibility

[fahadh4ilyas]

Does your xformers monkey patch compatible for llama model with default context (without condensed rotary embedding)? And you said in another issue that xformers can be use in non-A100 gpu, what kind of gpu that can use it? Does A6000 supports it?

[DachengLi1]

@fahadh4ilyas Thanks for trying! I think xformer document has a better list, it definitely supports V100 in my use case,