Daya Khudia

for debugging failure

6

Summary: For debugging failure in https://github.com/pytorch/FBGEMM/runs/3098255308 Differential Revision: D29784946

Fix for illegal instruction issue on windows

2

Summary: Windows tests sometimes fail with illegal instructions. I think this should fix it. I believe storeCRegs was getting picked from avx512 implementation. Reviewed By: efiks Differential Revision: D23034784

Insert a transformation once the loader is constructed.

8

Adding a transformation in the pipeline once the loader object is constructed results in the following error. ``` Traceback (most recent call last): File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner self.run()...

Look for package opencv.pc if opencv4.pc is not found

2

Conda env creates opencv4.pc (used by pkg-config) while apt install libopencv-dev creates opencv.pc. See https://github.com/libffcv/ffcv/issues/182 for more details.

torch_xla multi-device support

5

Adds support for multi-device training using torch_xla. The resnet9 on cifar10 trains fine on 2 GPUs using torch_xla. Some of the issues I ran into while adding this support: -...

Tensor Parallel MLP with torch2.0

2

This PR adds torch 2.0 based tensor parallel support for the ffn block. It's ported over from https://github.com/mosaicml/examples/pull/255 Currently the trained weights don't match between parallel/no-parallel versions even in a...