William Moses
William Moses
See CI on 1.10 cc @vchuravy @gbaraldi
### Motivation and description Arises when differentiating this model. ``` using Enzyme, Flux, Random, Test Enzyme.API.runtimeActivity!(true) loss(model, x) = sum(model(x)) function test_model(model, x, mi) println(model) l = loss(model, x) Flux.reset!(model)...
Follow up to https://github.com/FluxML/NNlib.jl/pull/536 I made this a separate PR, because for efficiency sake, it is better to have an inplace version of batchnorm, but that wasn't an exported API....
Wasn't sure how to integrate the sample test file into your infrastructure.