log-pilot icon indicating copy to clipboard operation
log-pilot copied to clipboard

log-pilot采集日志无法跟上业务输出的日志

Open huoxinyang opened this issue 4 months ago • 1 comments

配置:
- name: GOMAXPROCS value: "4" - name: PILOT_LOG_PREFIX value: ops - name: LOGGING_OUTPUT value: kafka - name: KAFKA_BROKERS value: xxx - name: KAFKA_SASL_MECHANISM value: SCRAM-SHA-512 - name: KAFKA_USERNAME value: logger - name: KAFKA_PASSWORD value:x x x - name: KAFKA_WORKER value: "16" - name: KAFKA_CLIENT_ID value: beats - name: KAFKA_BROKER_TIMEOUT value: "90" - name: KAFKA_KEEP_ALIVE value: 300s - name: KAFKA_REQUIRE_ACKS value: "0" - name: KAFKA_BULK_MAX_SIZE value: "40000" - name: KAFKA_CHANNEL_BUFFER_SIZE value: "20000" - name: KAFKA_MAX_MESSAGE_BYTES value: "20000000" - name: KAFKA_COMPRESSION value: lz4 - name: FILEBEAT_MAX_PROCS value: "8" - name: FILEBEAT_LOG_LEVEL value: debug - name: FILEBEAT_LOG_MAX_SIZE value: "536870912" - name: FILEBEAT_LOG_MAX_FILE value: "7" - name: QUEUE_MEM_EVENTS value: "40000" - name: QUEUE_MEM_FLUSH_MIN_EVENTS value: "4000" - name: QUEUE_MEM_FLUSH_TIMEOUT value: 5s limits是8c8g,但是实际利用率很低,如何优化配置呢?

huoxinyang avatar Oct 18 '24 07:10 huoxinyang