aibrix
aibrix copied to clipboard
[bug] Probes for quickstart model kill pod
🐛 Describe the bug
Probes for the sample found in /samples/quickstart/model.yaml restart the pod before the model can fully download.
Steps to Reproduce
- Deploy AIBrix Dependencies and Core
- Deploy /samples/quickstart/model.yaml
- Watch for pod restarts with
kubectl get pods - Watch for Readiness/Liveliness failures with
kubectl describe pod <pod-name> - Watch logs with
kubectl logs <pod-name> --follow
Expected behavior
Model starts up as expected. Changing the readiness and liveliness delay to 360 seconds fixes this issue.
Environment
- AIBrix Version 0.2.0
- Kubernetes Deployment
- Google Kubernetes Engine
- Deepseek-r1-distill-llama-8b
Just wanted to log this here in case somebody else runs into it. Will have a patch shortly.