equinox icon indicating copy to clipboard operation
equinox copied to clipboard

Easy mechanism to explicitly specify dynamic params

Open allen-adastra opened this issue 1 year ago • 2 comments

It would be nice if there were a mechanism to state which eqx.Module members are dynamic and a filter transformation that treats only elements marked dynamic as dynamic. This would be helpful for keeping track of what parameters in the model are "trainable" as we build and train larger eqx.Module subclasses.

Thoughts on the idea behind this pattern and how we may achieve it?

One option that comes to mind is to require the user to implement a dynamic_members() method that returns the members that are dynamic.

Another option would be to make a thin wrapper class around dynamic objects.s.

allen-adastra avatar Mar 02 '23 02:03 allen-adastra