flash-attention
flash-attention copied to clipboard
[BUG]2 tests failed...?
pytest -q -s test_flash_attn.py
And I meet this:
========================================= short test summary info ========================================== FAILED test_flash_attn.py::test_flash_attn_output[257-1-1.0-128-False-False-mha-dtype0] - AssertionError: assert 0.0078125 <= ((2 * 0.0) + 3e-05) FAILED test_flash_attn.py::test_flash_attn_output[257-1-1.0-128-True-False-mha-dtype0] - AssertionError: assert 0.0078125 <= ((2 * 0.0) + 3e-05) 2 failed, 2134 passed in 19.99s