Avik Pal
**Describe the example** A clear and concise description of what the example is. **Minimal Reproducible Example 👇** Without MRE, we would only be able to help you to a limited...
### Main Idea Place Nodes at points the BC is evaluate to minimize ODE Sensitivity Cost ### How it is done? - Create a wrapper around the ODESolution and capture...
cc @alanedelman
As discussed with @dhairyagandhi96 It would be good to have some scripts for timing the equivalent models in Knet. I am not particularly familiar with Knet so would be great...
Currently, FluxMPI has only [1 example](https://github.com/avik-pal/FluxMPI.jl/blob/main/examples/fastai/train.jl). It would be good to showcase training of more image models -- ViT (https://github.com/FluxML/Metalhead.jl/pull/105), ResNets, etc. from Metalhead and also benchmark their scaling across...
Backward Pass on GPUs currently fail due to ``` ERROR: InvalidIRError: compiling kernel broadcast_kernel(CUDA.CuKernelContext, CuDeviceArray{Float32,2,CUDA.AS.Global}, Base.Broadcast.Broadcasted{Nothing,Tuple{Base.OneTo{Int64},Base.OneTo{Int64}},typeof(Tracker.partial),Tuple{CUDA.CuRefValue{typeof(DiffEqBase.calculate_residuals)},Base.Broadcast.Extruded{CuDeviceArray{Float32,2,CUDA.AS.Global},Tuple{Bool,Bool},Tuple{Int64,Int64}},Int64,Base.Broadcast.Extruded{CuDeviceArray{Float32,2,CUDA.AS.Global},Tuple{Bool,Bool},Tuple{Int64,Int64}},Base.Broadcast.Extruded{CuDeviceArray{Float32,2,CUDA.AS.Global},Tuple{Bool,Bool},Tuple{Int64,Int64}},Base.Broadcast.Extruded{CuDeviceArray{Float32,2,CUDA.AS.Global},Tuple{Bool,Bool},Tuple{Int64,Int64}},Float32,Float32,CUDA.CuRefValue{typeof(DiffEqBase.ODE_DEFAULT_NORM)},Float32}}, Int64) resulted in invalid LLVM IR Reason: unsupported dynamic function invocation (call to partial(f::F,...
`RayTracer.jl` has been registered. So users don't need to install it manually anymore. It should be added to the Manifest and Project toml files.
Add CI
We should have some form of CI testing the differentiability of duckietown
```julia using Lux, ComponentArrays, Random, Enzyme rng = Random.MersenneTwister(1234) # Define a basic neural network structure NN = Lux.Chain(Lux.Dense(5 => 5, tanh), Lux.Dense(5 => 1)) # Setup the network ps,...