CMAK icon indicating copy to clipboard operation
CMAK copied to clipboard

kafka manager don't show consumer lag or Sum of partition offsets

Open evollu opened this issue 6 years ago • 14 comments

I don't know if it is config issue or not. The kafka manager can get everything except consumer lag. Can anyone help me?

I'm using kafka 1.0

Here are the screenshots screen shot 2017-12-18 at 9 20 20 pm screen shot 2017-12-18 at 9 20 31 pm

Here are the configs screen shot 2017-12-18 at 9 21 05 pm screen shot 2017-12-18 at 9 21 15 pm

I also checked logs, no errors at all.

evollu avatar Dec 19 '17 02:12 evollu

I am having the same issue even when using a PLAINTEXT protocol, but it only happens if any acls are set on the topic.

Arttii avatar Jan 29 '18 16:01 Arttii

I have acl=2. I will try removing it and see

evollu avatar Jan 29 '18 17:01 evollu

Has this problem been solved(adding acls then no offsets found in manager)?

leonjoyce avatar Mar 27 '18 09:03 leonjoyce

I have not checked yet, but I do not see the mentioned issue fixing this.

Arttii avatar Mar 27 '18 10:03 Arttii

Just my 2 cents here...

Having 2 equally configured clusters on my end:

  • dev consisting of one node, metric show up correctly there
  • prod consisting of 3 nodes, metric is always zero

Maybe it will be useful in investigation...

dene14 avatar Jun 11 '18 21:06 dene14

my cluster having issue has 3 nodes as well

evollu avatar Jun 13 '18 17:06 evollu

me too with api return like this

{
  "totalLag": null,
  "percentageCovered": 100,
  "partitionOffsets": [
    10,
    14,
    11,
    13,
    11,
    11,
    12,
    13,
    11,
    6
  ],
  "partitionLatestOffsets": [],
  "owners": [
    
  ]
}

thehackercat avatar Jul 23 '18 02:07 thehackercat

Not working on my single node, plaintext Kafka. Any progress on this issue?

shades198 avatar Mar 13 '19 14:03 shades198

I pulled up fresh release from master branch. Still nothing. I am using Kafka 2.0 btw. Please resolve this issue. It is a very critical and helpful feature.

shades198 avatar Mar 13 '19 14:03 shades198

I am running into some scala issues (This is little off topic here but I digged more to find a binary but didn't find one) [error] scala.reflect.internal.MissingRequirementError: object java.lang.Object in compiler mirror not found. Do we have any binaries to install this as a tool directly rather depending on src?

kiranemail3 avatar Sep 26 '19 15:09 kiranemail3

Someone already fixed it?

Allysh0w avatar Jan 24 '20 23:01 Allysh0w

I don't know if it is config issue or not. The kafka manager can get everything except consumer lag. Can anyone help me?

I'm using kafka 2.2.0 kafka-manager

I also checked logs, no errors at all.

And also one of the important thing is that my code base is processing messages and inserting to database as well. But why I posted this question is that I may not be to see lags in the topic is exist or not.

braj-ankit avatar Oct 27 '20 14:10 braj-ankit

Did anyone figure out the root case of the issue and fix it?

pareddy113 avatar Nov 11 '20 05:11 pareddy113

Getting the same issue, we're using PLAINTEXT. Any solution so far?

Tin-Nguyen avatar Jun 14 '22 14:06 Tin-Nguyen