log-pilot
log-pilot copied to clipboard
log-pilot采集日志无法跟上业务输出的日志
配置:
- name: GOMAXPROCS
value: "4"
- name: PILOT_LOG_PREFIX
value: ops
- name: LOGGING_OUTPUT
value: kafka
- name: KAFKA_BROKERS
value: xxx
- name: KAFKA_SASL_MECHANISM
value: SCRAM-SHA-512
- name: KAFKA_USERNAME
value: logger
- name: KAFKA_PASSWORD
value:x x x
- name: KAFKA_WORKER
value: "16"
- name: KAFKA_CLIENT_ID
value: beats
- name: KAFKA_BROKER_TIMEOUT
value: "90"
- name: KAFKA_KEEP_ALIVE
value: 300s
- name: KAFKA_REQUIRE_ACKS
value: "0"
- name: KAFKA_BULK_MAX_SIZE
value: "40000"
- name: KAFKA_CHANNEL_BUFFER_SIZE
value: "20000"
- name: KAFKA_MAX_MESSAGE_BYTES
value: "20000000"
- name: KAFKA_COMPRESSION
value: lz4
- name: FILEBEAT_MAX_PROCS
value: "8"
- name: FILEBEAT_LOG_LEVEL
value: debug
- name: FILEBEAT_LOG_MAX_SIZE
value: "536870912"
- name: FILEBEAT_LOG_MAX_FILE
value: "7"
- name: QUEUE_MEM_EVENTS
value: "40000"
- name: QUEUE_MEM_FLUSH_MIN_EVENTS
value: "4000"
- name: QUEUE_MEM_FLUSH_TIMEOUT
value: 5s
limits是8c8g,但是实际利用率很低,如何优化配置呢?