horde-ad icon indicating copy to clipboard operation
horde-ad copied to clipboard

Define a Tensor instance that does the fast forward derivative computation

Open Mikolaj opened this issue 1 year ago • 0 comments

That would mimic what ADModeDerivative did previously, but in a separated code path, taking advantage of the flexibility of the Tensor class.

Until this is done, we have the slow derivative, computed from delta expressions in the main code path. IIRC the speed difference wasn't that big. Probably the same tensor operations are performed, so the big cost is only the delta expressions taking up RAM and cache.

Mikolaj avatar Mar 20 '23 22:03 Mikolaj