Fix the issue of semaphore unreleased due to internal exception

[StephenZKCurry]

trafficstars

Why are these changes needed?

Fix the issue of semaphore unreleased due to internal exception

Related issue number (if applicable)

Checks

• [ ] I've run format.sh to lint the changes in this PR.
• [ ] I've included any doc changes needed.
• [ ] I've made sure the relevant tests are passing (if applicable).