Can MLP replace transformer?

[taotangSeek]

Hello author, I would like to know if the efficient implementation of MLP can replace the MLP module in transformer. What are the disadvantages and advantages?

[akaashdash]

https://github.com/akaashdash/kansformers