Elisewyh

### Description ```shell Is it possible to support mt5 acceleration by changing the activation function of mt5 to relu? Are there other things to pay attention to? ``` ### Reproduced...