GPUArrays.jl
GPUArrays.jl copied to clipboard
Published
20 hours ago •
JuliaGPU
JuliaGPU
Can `RNG` be moved to `GPUArraysCore`?
From the definition of the struct, it seems like it should be as simple as copy-pasting it over. I can open a PR for this, but wanted to know if there was any reason not to do this previously.
Metal and oneAPI default_rng return RNG objects, so it is very useful (in the deep learning context) to define dispatches on RNG to initialize data directly on the device (for weight initialization, functions that need random numbers on runtime, etc.). To do this I end up defining weakdeps like:
- https://github.com/LuxDL/WeightInitializers.jl/blob/main/ext/WeightInitializersGPUArraysExt.jl
- https://github.com/LuxDL/MLDataDevices.jl/blob/main/ext/MLDataDevicesGPUArraysExt.jl
Moving to GPUArraysCore makes it significantly easier, since that is quite lightweight to not need extensions.
