Arwa

icon indicating an email [email protected]

icon location Saudi Arabia icon location Navigating the labyrinth of knowledge, one byte at a time.

Results 2 comments of Arwa

[BUG]

same issue, did anyone figure how to solve this?

The mathematical trick in self-attention, why it returns false for torch.allclose(xbow, xbow2)?

@Ryan-ZL-Lin You can adjust the **relative tolerance** for less strict comparison. the default value is 1e-05 in PyTorch 2.2 This snippet will output `True` `torch.allclose(xbow, xbow2, rtol= 1e-04) # default...