torchrec icon indicating copy to clipboard operation
torchrec copied to clipboard

Faster KJT init

Open dstaay-fb opened this issue 1 year ago • 7 comments

Summary: To improve inference, we want to make creating a KJT as cheap as possible, which means the init method is nothing more than a attribute setter. All other fields are calculated lazily. This is practicularly important wrt jit script and moving between compilation units.

Differential Revision: D59765149

dstaay-fb avatar Jul 15 '24 18:07 dstaay-fb

This pull request was exported from Phabricator. Differential Revision: D59765149

facebook-github-bot avatar Jul 15 '24 18:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59765149

facebook-github-bot avatar Jul 16 '24 00:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59765149

facebook-github-bot avatar Aug 15 '24 01:08 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59765149

facebook-github-bot avatar Aug 26 '24 23:08 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59765149

facebook-github-bot avatar Aug 27 '24 20:08 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59765149

facebook-github-bot avatar Aug 27 '24 21:08 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59765149

facebook-github-bot avatar Aug 28 '24 19:08 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59765149

facebook-github-bot avatar Sep 03 '24 18:09 facebook-github-bot

This pull request has been reverted by f94e27bde8c3e75f37a4086c71f4744dfba737d5.

facebook-github-bot avatar Sep 04 '24 18:09 facebook-github-bot