ChainRulesCore.jl icon indicating copy to clipboard operation
ChainRulesCore.jl copied to clipboard

Published 20 hours ago • verified publisher icon JuliaDiff

RFC: turn off thunks at 2nd order

Open mcabbott opened this issue 3 years ago • 2 comments

mcabbott avatar Jul 25 '22 16:07 mcabbott

Why do we want to do this?

oxinabox avatar Aug 05 '22 13:08 oxinabox

This was part of https://github.com/FluxML/Zygote.jl/issues/1262#issuecomment-1193400476, tl;dr is that everything 2nd order in Zygote is broken. Besides problems with the Z-to-CR bridge, the creation of thunks doesn't seem to be differentiable, and ProjectTo also gave problems. But far from sorted out.

mcabbott avatar Aug 05 '22 13:08 mcabbott