torchrec icon indicating copy to clipboard operation
torchrec copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

Faster KJT init

Open dstaay-fb opened this issue 1 year ago • 1 comments

Summary: To improve inference, we want to make creating a KJT as cheap as possible, which means the init method is nothing more than a attribute setter. All other fields are calculated lazily. This is practicularly important wrt jit script and moving between compilation units.

Differential Revision: D57577131

Privacy Context Container: 1203980333745195

dstaay-fb avatar Jul 11 '24 04:07 dstaay-fb

This pull request was exported from Phabricator. Differential Revision: D57577131

facebook-github-bot avatar Jul 11 '24 04:07 facebook-github-bot