mup
mup copied to clipboard
Usage with torch.compile in Pytorch 2?
Is mup compatible with torch.compile() in Pytorch 2? If yes, what is the correct usage (e.g. should we apply mup before compile or after)?