Megatron-LM icon indicating copy to clipboard operation
Megatron-LM copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

[QUESTION] Why not use tensor parallel APIs of pytorch

Open GuWei007 opened this issue 9 months ago • 2 comments

Your question Ask a clear and concise question about Megatron-LM. https://pytorch.org/docs/stable/distributed.tensor.parallel.html Why not use tensor parallel APIs of pytorch

GuWei007 avatar May 16 '24 02:05 GuWei007