google
Retrying on google_cloud_utils.storage.copy_file_from failed.
Hi,
On the machines (Vms - linux) non-preemtible we see once for a while "INFO"/"ERROR" that the bot cannot fetch blob/blobs.
I'm wondering if this is a normal situation or maybe the CF in GCP has been incorrectly deployed.
If it is normal behaviour, then we have multiple retries and the "non-preemptible" machine is busy for quite a long time. How do you define a limit on the number of retries? Is it possible to customize it?
Any suggestions, or help?
Do you have more details on when this is happening? A full stacktrace would be helpful, thanks!
It is expected to see transient errors every now and then (and the retry parameters are here: https://github.com/google/clusterfuzz/blob/4f8020c4c7ce73c1da0e68f04943af30bb5f0b32/src/clusterfuzz/_internal/google_cloud_utils/storage.py#L748), but this seems to indicate a different problem.
