efk

[q1054261752]

[root@kube-node1 fluentd-elasticsearch]# kubectl get pods -n kube-system -o wide|grep -E 'elasticsearch|fluentd|kibana' elasticsearch-logging-0 0/1 CrashLoopBackOff 8 22m 172.30.88.2 kube-node3 elasticsearch-logging-1 0/1 CrashLoopBackOff 9 21m 172.30.13.4 kube-node1 fluentd-es-v2.0.4-6gxd9 1/1 Running 0 22m 172.30.88.4 kube-node3 kibana-logging-7445dc9757-8d7hm 1/1 Running 0 22m 172.30.13.3 kube-node1

[root@kube-node1 fluentd-elasticsearch]# kubectl describe pod elasticsearch-logging-1 --namespace=kube-system Name: elasticsearch-logging-1 Namespace: kube-system Node: kube-node1/172.27.129.105 Start Time: Fri, 08 Feb 2019 14:28:07 +0800 Labels: controller-revision-hash=elasticsearch-logging-568ccc8799 k8s-app=elasticsearch-logging kubernetes.io/cluster-service=true statefulset.kubernetes.io/pod-name=elasticsearch-logging-1 version=v5.6.4 Annotations: Status: Running IP: 172.30.13.4 Controlled By: StatefulSet/elasticsearch-logging Init Containers: elasticsearch-logging-init: Container ID: docker://8ce387d51785fcc7aff4a2279dfad446e09517a00ff134223c99e6fd0f159be9 Image: alpine:3.6 Image ID: docker-pullable://alpine@sha256:9c47dad65db1f3894530d2e3fa6b335c8178b32fd57cd27d6a4bf5d6771d3964 Port: Host Port: Command: /sbin/sysctl -w vm.max_map_count=262144 State: Terminated Reason: Completed Exit Code: 0 Started: Fri, 08 Feb 2019 14:28:10 +0800 Finished: Fri, 08 Feb 2019 14:28:10 +0800 Ready: True Restart Count: 0 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from elasticsearch-logging-token-mnzfb (ro) Containers: elasticsearch-logging: Container ID: docker://8c211a6b3b01090ed6627186c4433f2ca535db1b5c08cf97b4c016ba160669a3 Image: longtds/elasticsearch:v5.6.4 Image ID: docker-pullable://anjia0532/google-containers.elasticsearch@sha256:e2386ddc70a6f02770e05967e39f9a9a0b0346875f91aefe7c04c79577f89d2b Ports: 9200/TCP, 9300/TCP Host Ports: 0/TCP, 0/TCP State: Waiting Reason: CrashLoopBackOff Last State: Terminated Reason: Error Exit Code: 255 Started: Fri, 08 Feb 2019 14:49:45 +0800 Finished: Fri, 08 Feb 2019 14:49:47 +0800 Ready: False Restart Count: 9 Limits: cpu: 1 Requests: cpu: 100m Environment: NAMESPACE: kube-system (v1:metadata.namespace) Mounts: /data from elasticsearch-logging (rw) /var/run/secrets/kubernetes.io/serviceaccount from elasticsearch-logging-token-mnzfb (ro) Conditions: Type Status Initialized True Ready False PodScheduled True Volumes: elasticsearch-logging: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium:
elasticsearch-logging-token-mnzfb: Type: Secret (a volume populated by a Secret) SecretName: elasticsearch-logging-token-mnzfb Optional: false QoS Class: Burstable Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s node.kubernetes.io/unreachable:NoExecute for 300s Events: Type Reason Age From Message

---

Normal Scheduled 25m default-scheduler Successfully assigned elasticsearch-logging-1 to kube-node1 Normal SuccessfulMountVolume 24m kubelet, kube-node1 MountVolume.SetUp succeeded for volume "elasticsearch-logging" Normal SuccessfulMountVolume 24m kubelet, kube-node1 MountVolume.SetUp succeeded for volume "elasticsearch-logging-token-mnzfb" Normal Pulled 24m kubelet, kube-node1 Container image "alpine:3.6" already present on machine Normal Created 24m kubelet, kube-node1 Created container Normal Started 24m kubelet, kube-node1 Started container Normal Created 24m (x4 over 24m) kubelet, kube-node1 Created container Normal Started 23m (x4 over 24m) kubelet, kube-node1 Started container Normal Pulled 23m (x5 over 24m) kubelet, kube-node1 Container image "longtds/elasticsearch:v5.6.4" already present on machine Warning BackOff 4m (x84 over 24m) kubelet, kube-node1 Back-off restarting failed container

[q1054261752]

[root@kube-node1 fluentd-elasticsearch]# clear [root@kube-node1 fluentd-elasticsearch]# kubectl logs -f elasticsearch-logging-0 --namespace=kube-system

• export NODE_NAME=elasticsearch-logging-0
• NODE_NAME=elasticsearch-logging-0
• export NODE_MASTER=true
• NODE_MASTER=true
• export NODE_DATA=true
• NODE_DATA=true
• export HTTP_PORT=9200
• HTTP_PORT=9200
• export TRANSPORT_PORT=9300
• TRANSPORT_PORT=9300
• export MINIMUM_MASTER_NODES=2
• MINIMUM_MASTER_NODES=2
• chown -R elasticsearch:elasticsearch /data
• ./bin/elasticsearch_logging_discovery
• exec su elasticsearch -c ./bin/es-docker Killed [root@kube-node1 fluentd-elasticsearch]#

[q1054261752]

这是什么问题，麻烦给看看

[opsnull]

容器被 Kill 了，资源不足？