"pull QPS exceeded" error shouldn't be fatal

[leoluk]

Expected Behavior

When a pod fails to pull its image with a "pull QPS exceeded" ErrImagePull error, it might be better to let k8s retry the pull instead of failing. k8s doesn't seem to properly distinguish between permanent and temporary ErrImagePull errors, so I suspect Tilt just fails the job assuming the failure is fatal.

Current Behavior

Failed to pull image "registry.gha-prod.svc.cluster.local:5000/solana-contract:tilt-d0187147de2228a4": pull QPS exceeded

Context

tilt doctor Output

Tilt: v0.25.3, built 2022-03-04
System: linux-amd64
---
Docker
- Host: unix:///docker/docker.sock
- Server Version: 20.10.15
- API Version: 1.41
- Builder: 2
---
Kubernetes
- Env: unknown
- Context: ci
- Cluster Name: Unknown
- Namespace: gha-prod
- Container Runtime: read-failure
- Version: v1.21.2+k3s1
- Cluster Local Registry: {Host:registry.gha-prod.svc.cluster.local:5000 hostFromCluster: SingleName:}
---

[nicks]

thanks for the request. related to https://github.com/tilt-dev/tilt/issues/4194 and more configurability to the fail-fast handler in ci