graylog2-server icon indicating copy to clipboard operation
graylog2-server copied to clipboard

Search page (Log Table Widget) pagination stops changing the page contents after a certain number of pages

Open drewmiranda-gl opened this issue 1 year ago • 8 comments

When using the pagination for a Message Table widget, the contents of the message table stop changing. In the example I recorded below I hit a limit at page 66.

https://github.com/user-attachments/assets/c2c417c1-df7e-4051-ae54-c13587882162

Expected Behavior

Either pagination does not show pages that cannot be viewed, or pagination for the applicable page shows the proper log messages

Current Behavior

Pagination breaks after a certain number of pages.

Possible Solution

Steps to Reproduce (for bugs)

Context

https://community.graylog.org/t/absolute-date-range-not-working/33769

Your Environment

  • Graylog Version: 6.0.7
  • Java Version: Bundled
  • OpenSearch Version: 2.15.0
  • MongoDB Version: 7.0.14
  • Operating System: Ubuntu Server 22.04 LTS
  • Browser version: Safari

Please let me know if there are any questions.

drewmiranda-gl avatar Oct 04 '24 18:10 drewmiranda-gl

This might be related to https://github.com/Graylog2/graylog2-server/issues/18947, can you check if the response for the last request (/api/views/searchjobs/.../.../status) contains an error like this one?

image

linuspahl avatar Oct 06 '24 18:10 linuspahl

Yep! That's exactly it:

{
    "execution": {
        "done": true,
        "cancelled": false,
        "completed_exceptionally": true
    },
    "errors": [
        {
            "type": "result_window_limit",
            "description": "Result window is too large, [from + size] must be less than or equal to: [10000]. This limit can be set by changing the [index.max_result_window] index level setting, but it is recommended to use more advanced methods in order to get distant chunks of results (i.e. scroll or search after)",
            "search_type_id": "1ab94da5-0d53-4f72-b3dd-7fd4bbc4309a",
            "result_window_limit": 10000,
            "query_id": "f61480d0-217d-4e88-b73c-7a34963e4a19"
        }
    ]
}

drewmiranda-gl avatar Oct 07 '24 14:10 drewmiranda-gl

Thinking more about this, opened a FR that is related, though we can still fix this as well as implement the proposed FR:

https://github.com/Graylog2/graylog2-server/issues/20717

drewmiranda-gl avatar Oct 16 '24 16:10 drewmiranda-gl

Same exact issue Graylog Version: 6.0.6 and 6.1.8 Java Version: bundled Datanode Version: 6.0.6 and 6.1.8 MongoDB Version: 7.0.11 OS: Ubuntu 22.04 LTS Browser: FF/Chrome

This is running as a Docker Compose

spardok avatar Mar 24 '25 18:03 spardok

interesting bit of feedback from heather is that she says this behavior was not present prior to maybe 6.0 (not exactly sure on the version). Could this be true?

drewmiranda-gl avatar Jun 12 '25 14:06 drewmiranda-gl

Reopening this issue as the main problem was not fully address in https://github.com/Graylog2/graylog2-server/pull/22311 See: https://github.com/Graylog2/support/issues/206#issuecomment-2979140220

ryan-carroll-graylog avatar Jun 17 '25 17:06 ryan-carroll-graylog

see https://github.com/Graylog2/graylog2-server/issues/3571

see https://github.com/Graylog2/graylog2-server/issues/6928

janheise avatar Oct 13 '25 10:10 janheise

Also see support issue Graylog2/support#258: some customers have so many messages, that the new sliding window feature does not help much.

patrickmann avatar Dec 10 '25 09:12 patrickmann