mudballs

Miniscule Nitpicks. (1) Bad default gain for model initialization (2) misapplication of `nn.ModuleList`

3

Minuscule nitpicks. 1. Bad initialization gain value for ReLU nets. The initial weights for this feedforward block https://github.com/twitter/the-algorithm-ml/blob/78c3235eee5b4e111ccacb7d48e80eca019e480c/projects/home/recap/model/mask_net.py#L39 are set using https://github.com/twitter/the-algorithm-ml/blob/78c3235eee5b4e111ccacb7d48e80eca019e480c/projects/home/recap/model/mask_net.py#L10 This will initialize the block with uniform weights...