Backport: Fix: weariness makes hauling faster instead of slower; set weariness tracker in debug

[Brambor]

Summary

Bugfixes "Fix: weariness makes hauling faster instead of slower"

Purpose of change

• Backport #77220

Describe the solution

• Backport.
• cherry-picking the commits just worked, so I left it whole to prevent merge conflicts.

Describe alternatives you've considered

• Do not backport the debug addition.
• Do not backport the refactor (early escape) before the change.

Testing

Additional context