equinox icon indicating copy to clipboard operation
equinox copied to clipboard

Adding Support for Lazy Linear Layers

Open sgstepaniants opened this issue 8 months ago • 1 comments

Just wanted to ask if at any point, there is consideration to add support for Lazy Linear layers like in PyTorch: https://pytorch.org/docs/stable/generated/torch.nn.LazyLinear.html

This is a really useful feature, especially for convolution network architectures.

sgstepaniants avatar Apr 28 '25 22:04 sgstepaniants

Relevant previous discussion: https://github.com/patrick-kidger/equinox/issues/949

lockwo avatar Apr 29 '25 00:04 lockwo