torchrec icon indicating copy to clipboard operation
torchrec copied to clipboard

add dense kernel for all sharding types

Open Ye-Tian-Zero opened this issue 1 year ago • 2 comments

Summary: Allow to use dense kernel for all kinds of sharding types.

More details: https://github.com/pytorch/torchrec/issues/1614#issuecomment-1980378724

Ye-Tian-Zero avatar May 17 '24 06:05 Ye-Tian-Zero

@colin2328 what do you think? do you know why we disabled it in the first place?

henrylhtsang avatar May 17 '24 17:05 henrylhtsang

@colin2328 Any suggestion?

Ye-Tian-Zero avatar May 24 '24 07:05 Ye-Tian-Zero