console icon indicating copy to clipboard operation
console copied to clipboard

How to change size of max results, currently max is 500 (frontend)

Open nitin1677 opened this issue 3 years ago • 5 comments

when we try to search events in kafka topic based on timestamp or offset, max we can see up to 500 events.

If kafka topics has larger no of events based on search pattern, how to navigate events if larger than 500.

nitin1677 avatar Jul 20 '22 17:07 nitin1677

If you use search filters the code is run on the backend. Thus the messages will not even be sent to the frontend - and therefore not count towards the max results / 500 events limit - in case the filter returns false.

If you want to search the whole topic, use start offset = oldest, enable your search filter and start your search. Does that help?

weeco avatar Jul 20 '22 18:07 weeco

how to read all messages / filtered messages in topic, if resulting no of messages are > 500, may be if couple of hundreds of thousands events in result. Limit with Max Results / 500 is blocking to review the events from the page.

nitin1677 avatar Jul 21 '22 14:07 nitin1677

Because the frontend resources are limited in browsers like Chrome it wouldn't be safe to send all messages to the frontend. That's why we limit the number of messages to 500. Does that make sense?

weeco avatar Aug 09 '22 15:08 weeco

@nitin1677 you can follow my commit where I change size to 100.000 (https://github.com/victorgawk/kowl/commit/71ac6c369c76469aaac1307496f57575bbdbd481).

You probably will need also increase the timeout to list messages too since it defaults to 45 seconds (https://github.com/victorgawk/kowl/commit/89fb8fa716898b98b51ca1b2e152f355ab86e9df).

victorgawk avatar Aug 10 '22 00:08 victorgawk

sure, let me try that.

nitin1677 avatar Aug 24 '22 19:08 nitin1677