mxpf4 moe block_m 32

[xudoyuan]

Proposed changes

Please describe the motivation behind the pull request, whether it enables a new feature or fixes a bug. If there are associated pull requests or issues, please link them to the pull request.

Checklist

Please put an x into the boxes that apply. You can also fill these out after creating the PR. If you're not sure, please don't hesitate to ask.

• [ ] I have added tests relevant to the introduced functionality, and the unit tests are passing locally
• [ ] I have added the test to REGRESSION_TESTS list defined at the top of CMakeLists.txt in tests/CMakeLists.txt, IF the test takes more than 30 seconds to run.
• [ ] I have added inline documentation which enables the maintainers with understanding the motivation
• [ ] I have removed the stale documentation which is no longer relevant after this pull request
• [ ] (If this change is user-facing) I have added release notes which provide the end users with a brief summary of the improvement from this pull request
• [ ] I have run clang-format on all changed files
• [ ] Any dependent changes have been merged

Discussion

If this is a relatively large or complex change, feel free to start a discussion by explaining why you chose the solution you did and what alternatives you considered

[illsilin]

Can you please describe the purpose of this PR and make sure the CI is passing?

[cgmillette]

@xudoyuan Ping again please provide a proper description of the changes you are intending to make and address comments. Thank you!

[illsilin]

Hi @coderfeli, can you please bring this one across the finish line?

[cgmillette]

@xudoyuan closing due to inactivity