Lux.jl icon indicating copy to clipboard operation
Lux.jl copied to clipboard

Published 20 hours ago • verified publisher icon LuxDL

Inbuilt-Distributed Setup

Open avik-pal opened this issue 1 year ago • 3 comments
trafficstars

Fixes https://github.com/LuxDL/Lux.jl/issues/494

  • [x] FluxMPI Parity
    • [x] Optimisers
    • [x] CUDA MPI Support
    • [x] AMDGPU MPI Support
  • [x] Tutorial (ImageNet Example is completely functional again)
  • [ ] Documentation
  • [ ] Testing
  • [x] Upstream the following Patch to NCCL (https://github.com/JuliaGPU/NCCL.jl/pull/54)
  • [ ] https://github.com/LuxDL/LuxDeviceUtils.jl/pull/37 provides the set_device functionality now

avik-pal avatar Feb 25 '24 06:02 avik-pal