xla
xla copied to clipboard
Misc bug fixes in Zero optimizer: handling differentiable argument, optimizer_dtype
This a cumulative PR with misc bug fixes and updates to Zero Redundancy Optimizer from all the authors (AWS): Guangtai Huang, Rahul Solanki, Fei Wu, Amith Mamidala