LightX2V icon indicating copy to clipboard operation
LightX2V copied to clipboard
Published 4 days ago • verified publisher icon ModelTC

Why is sage_attn2 disabled on H100 with CPU offload?

Open fffanty opened this issue 4 months ago • 5 comments

Found this restriction in the code: https://github.com/ModelTC/LightX2V/blob/4f3534923b64cc4fb3b7bbb8343fa224737ee6b5/lightx2v/models/networks/wan/infer/transformer_infer.py#L39

Why is sage_attn2 incompatible with H100 (compute capability 9.0) + CPU offload? Thank you for your time! Could you please explain the reasoning behind this restriction?

fffanty avatar Aug 08 '25 02:08 fffanty