torchrec icon indicating copy to clipboard operation
torchrec copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

Benchmarking

Open dstaay-fb opened this issue 1 year ago • 0 comments

Summary: Benchmark existing training benchmarks, training performance and memory on multi-gpu setups

TrainPipelineBase | Runtime (P90): 13.1 s | Memory (P90): 8.4 GB TrainPipelineSparseDist | Runtime (P90): 12.7 s | Memory (P90): 8.8 GB

Differential Revision: D56690925

dstaay-fb avatar Apr 29 '24 06:04 dstaay-fb