pd is causing tikv:8252 error when resource usage hasn't reach limit and io latency increased

[mzhang77]

Bug Report

1. Minimal reproduce step (Required)

Production system running normal

2. What did you expect to see? (Required)

No spike of any issue

3. What did you see instead (Required)

At problem time, we see a spike of tikv:8252 Resource Group Quota Limitation error:

But the resource group has not exceed resouce limit:

There is issue with PD:

And it appears there is a spike on IO latency:

4. What is your TiDB version? (Required)

v7.5.3