pulsar icon indicating copy to clipboard operation
pulsar copied to clipboard

[Bug] Unexpected count of entries in bookie

Open ub-3 opened this issue 7 months ago • 0 comments

Search before reporting

  • [x] I searched in the issues and found nothing similar.

Read release policy

  • [x] I understand that unsupported versions don't get bug fixes. I will attempt to reproduce the issue on a supported version of Pulsar client and Pulsar broker.

User environment

  • Broker version
Current version of pulsar is: 4.0.2
Git Revision 339b270b4cd8b46c231448f3a9492c7dcd12496c
Git Branch branch-4.0
Built by Lari Hotari <[email protected]> on Laris-MBP.lan at 2025-01-03T23:52:44+0200
  • Broker Operating system and hardware type
Linux 5.15.0-89-generic #99-Ubuntu SMP Mon Oct 30 20:42:41 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
  • Broker java version
openjdk version "17.0.10" 2024-01-16
OpenJDK Runtime Environment (build 17.0.10+7-Ubuntu-120.04.1)
OpenJDK 64-Bit Server VM (build 17.0.10+7-Ubuntu-120.04.1, mixed mode, sharing)
  • Client library type Go
  • Client library version v0.15.1
  • Client Operating system and hardware type
Linux 5.15.0-89-generic #99-Ubuntu SMP Mon Oct 30 20:42:41 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Issue Description

One day(05/12 on the screenshot), I noticed that the number of entries in a bookie increased significantly. At the same time, minor and major compactions started taking much longer to complete. According to the metrics, there’s nothing unusual happening in the topics — no spikes in topic backlogs either. How can I figure out what these entries are and where they're coming from?

Image

Error messages


Reproducing the issue

Additional information

No response

Are you willing to submit a PR?

  • [ ] I'm willing to submit a PR!

ub-3 avatar Jun 08 '25 22:06 ub-3