nengolib
nengolib copied to clipboard
Orthogonal ensemble
Should figure out the best way to consolidate this with the RollingWindow
use-case. This is most useful as an idea for the time-being: many nonlinear functions can be computed very accurately using orthogonal encoders by the appropriate change-of-basis (the Product network is one example). It would be great to solve for the decoders more efficiently, and have tools for experimenting with changes of basis (or even theory for finding the best basis)!