No need to add a rigidbody2d component to gameobject

[KirinHorse]

Rigidbody2d may causes some wrong movement often. And you required a rigidbody but never use it. I removed the rigidbody and it works better now.

[riktothepast]

We can remove the Rigid Body from the Character Controller, but we need to add Rigid Bodies to the triggers in order to detect events, it may be better to leave the rigid bodies on the triggers as they might not move? Let me know what do you think.