k8s-ci-robot cannot correctly remove the label related to the deleted code

[rayowang]

What happened: It may be that I used git rebase improperly, which led to the introduction of a large number of new commits in my PR. At this time, k8s-ci-robot added a lot of labels related to these commit codes, but when I removed these incorrect commits Afterwards, k8s-ci-robot did not remove the related label.

What you expected to happen:

After removing the commit related to the labeled label, the previously labeled label should also be removed.

How to reproduce it (as minimally and precisely as possible):

Please provide links to example occurrences, if any: https://github.com/kubernetes/kubernetes/pull/118636

Anything else we need to know?: