StevenBanama

how to run internvl1.5-8bit with nvidia v100

6

ERROR about flash_attr, can u help to provide version for these old nv card? --------------------------- out, q, k, v, out_padded, softmax_lse, S_dmask, rng_state = flash_attn_cuda.fwd( ^^^^^^^^^^^^^^^^^^^^ RuntimeError: FlashAttention only supports...