Pull request status not updated until job starts

[hol430]

We're using this plugin to build pull requests on a repo with quite a few contributors, and we don't allow jenkins to build pull requests in parallel, so it's common to see a backlog of several jobs in jenkins' queue.

Everything is working great, except for one small issue, which happens when someone retests their pull request - either via comment or by pushing to their branch. A new job is added to jenkins' queue, but the status on the pull request is not updated until jenkins actually starts running the job, which in our case, can often be an hour or two after the user requests the tests to be rerun. Is this deliberate? I can probably implement some sort of workaround on my end but was wondering if there's a setting I missed somewhere.