Excessive DEBUG logging by Kafka consumer

Open mingfang opened this issue 6 years ago • 1 comments

When using the Kafka connector OBP_CONNECTOR = "kafka_vSept2018" I'm seeing a constant stream of debugging logs like this

06:10:37.788 [Thread-12] DEBUG org.apache.kafka.clients.consumer.internals.Fetcher - [Consumer clientId=consumer-1, groupId=obp-api-north.side.consumer] Added READ_UNCOMMITTED fetch request for partition to.obp.api.0.caseclass.OutboundGetAccounts-0 at offset 0 to node kafka-0.kafka.obp-example.svc.cluster.local:9092 (id: 1001 rack: null)

I tried and unable to turn the logs off by setting

OBP_LOGGER_LOGLEVEL = "INFO"
OBP_AKKA_CONNECTOR_LOGLEVEL = "INFO"

How do I silence the Kafka DEBUG logs?

Jan 25 '20 06:01 mingfang

My solution is specific to my Kubernetes setup but serve as a good reference https://github.com/mingfang/terraform-k8s-modules/blob/master/modules/open-banking-project/logback.xml

Basically I added this to /jetty/resources/logback.xml

  <logger name="org.apache.kafka" level="INFO"/>
  <logger name="org.apache.kafka.common.metrics" level="INFO"/>

Jan 26 '20 02:01 mingfang