Gautier Hamon

Question: Number of layers of the position wise MLP in transformer block.

1

Hi, Thanks for the well written code ! I was wondering if you've explored the impact of the number of layers in the position wise MLP in the transformer block....