[Subtask]: Fix all issues about releasing the new version

[zhoujinsong]

Search before asking

• [x] I have searched in the issues and found no similar issues.

Description

We should fix all issues regarding releasing the new version, including:

• #3770

Parent issue

#3827

Are you willing to submit PR?

• [ ] Yes I am willing to submit a PR!

Code of Conduct

• [x] I agree to follow this project's Code of Conduct