torchrec icon indicating copy to clipboard operation
torchrec copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

Add numerical equivalence tests

Open henrylhtsang opened this issue 1 year ago • 2 comments

Summary: Adding numerical equivalence tests for different kernel types.

Note that when stochastic rounding = True + is_training = True is always a bit tricky. However, from what FBGEMM team said, it is not guaranteed to have iteration-wise equivalence, but it's guaranteed to have numerical equivalence in the long term.

Differential Revision: D53878573

henrylhtsang avatar Feb 22 '24 01:02 henrylhtsang

This pull request was exported from Phabricator. Differential Revision: D53878573

facebook-github-bot avatar Feb 22 '24 01:02 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D53878573

facebook-github-bot avatar Feb 22 '24 01:02 facebook-github-bot