torchrec icon indicating copy to clipboard operation
torchrec copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

Create BoundsCheckMode fused_param for inference

Open PaulZhang12 opened this issue 9 months ago • 0 comments

Summary: Introduce BoundsCheckMode fused_param for TBE BoundsCheckMode. There is no reason really to run bounds_check_indices during inference use case (AIMP has it off by default: https://fburl.com/code/q8zhundg), and it causes issues with the PT2 IR (bounds_check_indices is a mutating op)

Differential Revision: D56743992

PaulZhang12 avatar Apr 30 '24 15:04 PaulZhang12