cvat icon indicating copy to clipboard operation
cvat copied to clipboard

CVAT deployment on Kubernetes with Helm

Open joon612 opened this issue 11 months ago • 4 comments

Is the section of this document creating superuser up to date? I encountered an error while executing. I only did few changes on elm-chart\values.override.yaml

postgresql:
  secret:
    password: XXXX
    postgres_password: XXXX
    replication_password: XXXX
traefik:
  service:
    externalIPs:
      - 192.168.49.2

CVAT version: v2.11.1 System: Windows 11 Docker version: Docker Desktop 4.28.0 (139021) Minikube version: v1.32.0 Helm version: v3.14.2

Ref: https://opencv.github.io/cvat/v2.11.2/docs/administration/advanced/k8s_deployment_with_helm/#post-deployment-configuration

$ kubectl get pods -n cvat
NAME                                                           READY   STATUS             RESTARTS          AGE
cvat-latest-backend-server-77cb6788c4-tdmtq                    1/1     Running            0                 45h
cvat-latest-backend-utils-8d74459c6-zblm9                      1/1     Running            0                 45h
cvat-latest-backend-worker-analyticsreports-75ff865966-pvbcp   1/1     Running            0                 45h
cvat-latest-backend-worker-annotation-7fc4f669c7-jmr87         1/1     Running            0                 45h
cvat-latest-backend-worker-export-85bf7fdfdf-dmnsk             1/1     Running            0                 45h
cvat-latest-backend-worker-export-85bf7fdfdf-n9p5f             1/1     Running            0                 45h
cvat-latest-backend-worker-import-854c7cf5fc-4cjj7             1/1     Running            0                 45h
cvat-latest-backend-worker-import-854c7cf5fc-8qqwr             1/1     Running            0                 45h
cvat-latest-backend-worker-qualityreports-6b48d9cdd-rzdz4      1/1     Running            0                 45h
cvat-latest-backend-worker-webhooks-869cb8f549-sp6rn           1/1     Running            0                 45h
cvat-latest-clickhouse-shard0-0                                1/1     Running            0                 45h
cvat-latest-frontend-6b9668fbf5-f7v9z                          1/1     Running            0                 45h
cvat-latest-grafana-7f88fbdb49-4rjjk                           1/1     Running            106 (22h ago)     44h
cvat-latest-kvrocks-0                                          1/1     Running            0                 45h
cvat-latest-opa-6fcc67cd6b-d668r                               1/1     Running            0                 45h
cvat-latest-postgresql-0                                       1/1     Running            0                 45h
cvat-latest-redis-master-0                                     1/1     Running            0                 45h
cvat-latest-vector-0                                           0/1     CrashLoopBackOff   114 (3m32s ago)   45h

$ kubectl exec -it --namespace cvat cvat-latest-backend-server-77cb6788c4-tdmtq -c cvat-backend-app-container -- python manage.py createsuperuser
Error from server (BadRequest): container cvat-backend-app-container is not valid for pod cvat-latest-backend-server-77cb6788c4-tdmtq

B.T.W., cvat-latest-vector-0 cannot start by no reason. Here is the pod log:

$ kubectl logs cvat-latest-vector-0 -n cvat
2024-03-14T05:39:35.760927Z  INFO vector::app: Internal log rate limit configured. internal_log_rate_secs=10
2024-03-14T05:39:35.761003Z  INFO vector::app: Log level is enabled. level="vector=info,codec=info,vrl=info,file_source=info,tower_limit=trace,rdkafka=info,buffers=info,lapin=info,kube=info"
2024-03-14T05:39:35.761056Z  INFO vector::app: Loading configs. paths=["/etc/vector"]
2024-03-14T05:39:35.761244Z ERROR vector::cli: Configuration error. error=No sources defined in the config.
2024-03-14T05:39:35.761262Z ERROR vector::cli: Configuration error. error=No sinks defined in the config.

joon612 avatar Mar 14 '24 06:03 joon612

I believe documentation is not updated, it is fetching different pod, when I use this command: BACKEND_POD_NAME=$(kubectl get pod --namespace $HELM_RELEASE_NAMESPACE -l tier=backend,app.kubernetes.io/instance=$HELM_RELEASE_NAME -o jsonpath='{.items[0].metadata.name}')

The correct commands you can use are as follows:

BACKEND_POD_NAME=$(kubectl get pod --namespace $HELM_RELEASE_NAMESPACE -l tier=backend,app.kubernetes.io/instance=$HELM_RELEASE_NAME,component=server -o jsonpath='{.items[0].metadata.name}')
kubectl exec -it --namespace $HELM_RELEASE_NAMESPACE $BACKEND_POD_NAME -c cvat-backend -- python manage.py createsuperuser

abhi-bhatra avatar Mar 18 '24 06:03 abhi-bhatra

cvat-latest-vector-0

Thanks for help, do you know the reason of cvat-latest-vector-0 cannot run on Windows but Linux?

joon612 avatar Mar 18 '24 06:03 joon612

Still investigating on this !

abhi-bhatra avatar Mar 18 '24 06:03 abhi-bhatra

Still investigating on this !

Is there any update? @abhi-bhatra

joon612 avatar Apr 01 '24 05:04 joon612

Fixed in #7631

azhavoro avatar Jun 18 '24 13:06 azhavoro