flash-attention icon indicating copy to clipboard operation
flash-attention copied to clipboard

[BUG]2 tests failed...?

Open ziyuhuang123 opened this issue 5 months ago • 0 comments

pytest -q -s test_flash_attn.py

And I meet this:

========================================= short test summary info ========================================== FAILED test_flash_attn.py::test_flash_attn_output[257-1-1.0-128-False-False-mha-dtype0] - AssertionError: assert 0.0078125 <= ((2 * 0.0) + 3e-05) FAILED test_flash_attn.py::test_flash_attn_output[257-1-1.0-128-True-False-mha-dtype0] - AssertionError: assert 0.0078125 <= ((2 * 0.0) + 3e-05) 2 failed, 2134 passed in 19.99s

ziyuhuang123 avatar Sep 16 '24 10:09 ziyuhuang123