Manuel Kaufmann
Manuel Kaufmann
Cool. I will add this to the first sprint of next year, I don't want to merge this during Xmas just in case 😄
> I will check -ops repositories and corporate now. I didn't find any code that requires changes there.
@stsewd this is ready to re-review and merge from my side.
I opened a PR on corporate to trigger tests on CircleCI: https://github.com/readthedocs/readthedocs-corporate/pull/2080
It seems tests related to the storage are passing correctly.
The big gaps are not because of queue contention, they happen on projects hitting concurrency limit constantly. When the build is mark to be retried in 5 minutes in the...
> I'm not describing the cumulative difference between commands executing or something, I'm describing the time difference between the worker setting the task to retry and actually picking up the...
> It might just be easier to add some code and try to log this scenario when we notice it at the code level How are you thinking we can...
I opened https://github.com/readthedocs/readthedocs.org/pull/12500 to save `Build.task_executed_at` when the task containing the build is grabbed by a worker. The worker checks if the build was _created or retried_ more than 10...
In less than a day we have +80 builds hitting the 10 minutes waiting time: https://onenr.io/0VRVvvbEvRa