Uni-Core
Uni-Core copied to clipboard
an efficient distributed PyTorch framework
Hi, Not really an issue but a suggestion... I had to add Ada Lovelace support to your installer to use it on my PC. It could be useful to add...
An error message during installation is brought by the commit https://github.com/dptech-corp/Uni-Core/commit/57460f0817d1a284cd47169b981d52e0f2e58ff8, on the following platform: A100 with Driver Version: 520.61.05 and CUDA Version: 11.8. I install PyTorch with version 2.2.0...
Dear developers, I am trying to install a cpu version of Uni-Core on WSL from the source using command `python setup.py install --disable-cuda-ext`. But I always get the following message:...
* Use `torch.optim.AdamW` as fallback Adam implementation. * Support selecting the fused versions of the optimizers (via `--use-fused-optimizer`). Speed: custom_fused (only available for Adam) > fused > foreach
This PR replaces the custom EMA implementation with the one in PyTorch. Note that this PR breaks backward compatibility: it cannot load old-format checkpoints that were generated with ema enabled.