Lux.jl icon indicating copy to clipboard operation
Lux.jl copied to clipboard

Add a faster activation path

Open avik-pal opened this issue 1 year ago • 0 comments

  • ~sigmoid_fast fails on GPU as pointed out in the NNlib PR. Need to work around that~
  • ~Specialize WrappedFunction on Broadcast.BroadcastFunction~ --> can't do this mutation will violate purity wrt input/output arrays
  • #570 pulls out the easy part of this

Remaining Problems:

  • [ ] Type Stability failure for DEQs
  • [ ] NeuralPDE failure

avik-pal avatar Mar 21 '24 02:03 avik-pal