log-pilot
log-pilot copied to clipboard
Collect logs for docker containers
执行 `go get github.com/AliyunContainerService/log-pilot` 命令 报错误 ``` get github.com/AliyunContainerService/log-pilot go: github.com/AliyunContainerService/log-pilot upgrade => v0.9.7 go: finding module for package github.com/Sirupsen/logrus go: finding module for package github.com/docker/docker/client go: finding module for...
根据 readme,通过执行 build-image.sh 构建镜像, 运行 quickstart 下的 run 程序报如下错误。 `start log-pilot: filebeat Traceback (most recent call last): File "/pilot/entrypoint", line 58, in config() File "/pilot/entrypoint", line 51, in config subprocess.check_call(['/pilot/config.filebeat'])...
查看log-polit 日志,可查看能正常解析格式,如下格式。 {"@timestamp":"2019-01-04T17:24:46.920Z","@metadata":{"beat":"filebeat","type":"doc","version":"6.1.1"},"prospector":{"type":"log"},"beat":{"hostname":"log-pilot-qmg2z","version":"6.1.1","name":"log-pilot-qmg2z"},"stream":"stdout","message":"2019-01-05 01:24:46.919 WARN 1 --- [nfoReplicator-0] o.s.b.actuate.mail.MailHealthIndicator : Mail health check failed\n\ncom.sun.mail.util.MailConnectException: Couldn't connect to host, port: smtp.servingcloud.com, 25; timeout -1\n\tat com.sun.mail.smtp.SMTPTransport.openServer(SMTPTransport.java:2209) ~[javax.mail-1.6.2.jar!/:1.6.2]\n\tat com.sun.mail.smtp.SMTPTransport.protocolConnect(SMTPTransport.java:740) ~[javax.mail-1.6.2.jar!/:1.6.2]\n\tat javax.mail.Service.connect(Service.java:366) ~[javax.mail-1.6.2.jar!/:1.6.2]\n\tat org.springframework.mail.javamail.JavaMailSenderImpl.connectTransport(JavaMailSenderImpl.java:515)...
issue:https://github.com/AliyunContainerService/log-pilot/issues/253
日志采集器的存储后端是否可以支持PostgreSQL,在生产环境中,ES需要的资源比较多,需要支持轻量级的存储后端。
fluentd关于容器log的pos是记录在`pos_file /pilot/pos/{{ $.containerId }}.{{ .Name }}.pos`这里,但是在pod中容器重启之后log所在的目录不会变,容器id发生了变化,所以pos也就发生了变化,fluentd就会对重启之后的log进行重采集,造成log采集重复,有没有遇到这种情况,反正我遇到了
如果落在nas盘上,无法通过容器内文件采集的方式采集,只能配置一个规则,而每个规则会应用上多个目录上,导致采集重复?
# 容器内文件日志路径需要配置emptyDir volumeMounts: - name: tomcat-log mountPath: /usr/local/tomcat/logs volumes: - name: tomcat-log emptyDir: {} 这里的emptyDir 可以换成NAS 数据卷吗?
每次更新配置重启pod或者删除重启都会采集大量重复日志 版本:0.9.7 采集方式:log-pilot-fluentd yaml ```yaml apiVersion: extensions/v1beta1 kind: DaemonSet metadata: name: log-pilot namespace: elk labels: k8s-app: log-pilot spec: updateStrategy: type: RollingUpdate template: metadata: labels: k8s-app: log-pilot annotations: last-updated: '2019-09-11 22:46:22'...