azure-functions-kafka-extension
azure-functions-kafka-extension copied to clipboard
A lot of redundant logs produced
Due to unresolved Kafka issue described here https://github.com/confluentinc/confluent-kafka-dotnet/issues/1861 there are a lot of errors can be produced in log collection storage when the services run because of this error logging: https://github.com/Azure/azure-functions-kafka-extension/blob/59f93fb60603a7428f6975b7f7836ece78e8cd19/src/Microsoft.Azure.WebJobs.Extensions.Kafka/Trigger/FunctionExecutorBase.cs#L91 Because the lib strangle errors within catch block - assuming the errors here aren't fatal/critical so the log level can be decreased.
So, can the log level be decreased or parametrized so lib consumer can control logs and decrease level on demand then a bunch of redundant logs could be omitted in logging system?
We are working on upgrading the confluent kafka sdk to 2.4.0 - which seems to not have the above-mentioned Erroneous state issue. That should automatically take care of the unnecessary error logging for the extension.