Lux.jl icon indicating copy to clipboard operation
Lux.jl copied to clipboard

Rework ChainRules for DynamicExpressions

Open avik-pal opened this issue 1 year ago • 1 comments

DynamicExpressions supports ChainRules starting v0.17 https://github.com/SymbolicML/DynamicExpressions.jl/pull/71. We can remove parts of our code with CRC.rrule_via_ad. We still need to define a rule because we do an in-place node update. Additionally we need to extract the node parameters in the final parameter gradient.

avik-pal avatar Apr 29 '24 14:04 avik-pal