azure-functions-kafka-extension icon indicating copy to clipboard operation
azure-functions-kafka-extension copied to clipboard

A lot of redundant logs produced

Open amaestr0 opened this issue 1 year ago • 1 comments

Due to unresolved Kafka issue described here https://github.com/confluentinc/confluent-kafka-dotnet/issues/1861 there are a lot of errors can be produced in log collection storage when the services run because of this error logging: https://github.com/Azure/azure-functions-kafka-extension/blob/59f93fb60603a7428f6975b7f7836ece78e8cd19/src/Microsoft.Azure.WebJobs.Extensions.Kafka/Trigger/FunctionExecutorBase.cs#L91 Because the lib strangle errors within catch block - assuming the errors here aren't fatal/critical so the log level can be decreased.

So, can the log level be decreased or parametrized so lib consumer can control logs and decrease level on demand then a bunch of redundant logs could be omitted in logging system?

amaestr0 avatar Apr 12 '24 12:04 amaestr0

We are working on upgrading the confluent kafka sdk to 2.4.0 - which seems to not have the above-mentioned Erroneous state issue. That should automatically take care of the unnecessary error logging for the extension.

jainharsh98 avatar Aug 02 '24 06:08 jainharsh98