PiPPy icon indicating copy to clipboard operation
PiPPy copied to clipboard

[SPMD][Fusion] - ensure buffer dtype matches gradient tensor dtype

Open lessw2020 opened this issue 3 years ago • 0 comments

Currently we default to FP32 for the fusion buffer, but that is not correct for mixed precison cases. Thus, need to check shape prop metadata and build correct buffer dtype.

lessw2020 avatar Nov 29 '22 01:11 lessw2020