torchrec icon indicating copy to clipboard operation
torchrec copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

micro-lut

Open dragonxlwang opened this issue 2 years ago • 3 comments

Summary: Micro hash Lookup, a LUT learnt from both sparse ID and optionally embeddings.

  1. reduced hash collision: id is mapped to num_shards hash slots and embedding is concat from each shard with the hashed ids.

  2. embedding from LUT is used to construct given input embedding (oracle).

Differential Revision: D50567073

dragonxlwang avatar Nov 18 '23 04:11 dragonxlwang

This pull request was exported from Phabricator. Differential Revision: D50567073

facebook-github-bot avatar Nov 18 '23 04:11 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D50567073

facebook-github-bot avatar Nov 20 '23 02:11 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D50567073

facebook-github-bot avatar Dec 11 '23 18:12 facebook-github-bot