Questions about the MLPi tune

[Qi-Zhangyang]

and

About the MLPi tune, it is a shared MLP. In the paper, you say it has 32 layers. But in the code it seems only 1 layer.

    self.shared_mlp = nn.Linear(self.embed_dim//self.scale_factor, self.embed_dim)