anomaly-detection-dashboards-plugin icon indicating copy to clipboard operation
anomaly-detection-dashboards-plugin copied to clipboard

Update _cat/indices to new, paginated _list/indices API

Open amitgalitz opened this issue 1 year ago • 4 comments

Is your feature request related to a problem? We should use the new _list/indices API instead of _cat/indices to better handle fetching of indices as current cat API consumes too many resources.

Issue for new _list/indices API: https://github.com/opensearch-project/OpenSearch/pull/15986 issue for context on limitation of CAT api: https://github.com/opensearch-project/OpenSearch/issues/15954

What solution would you like? Changing to a paginated API means we need to potentially change our UI as well as we will either need a mechanism to make API calls to the next set of results or relay more so on our search functionality and only display a limited (1k) number of results on the frontend at a time.

Options:

Option 1: Make the changes to list/indices and we set default to 1k without implementing pagination.

Pros:

  • Quicker implementation and clusters with over 1k indices are less common
  • Users don’t usually scroll through 1k indices in drop down without search

Cons:

  • Users will only see up to 1k indices, They need to search to easily find their index if they have more then 1k but technically it also means search results will only show up to 1k results.

Option 2: Change index selection drop down to include pagination or other UI based mechanism to fetch the next page of results

Pros:

  • This means that the user has a way to view all indices through the drop down

Cons:

  • Viewing all indices through a drop down when we reach 10k+ indices might be less useful as the number of "pages" might get too high

amitgalitz avatar Oct 28 '24 20:10 amitgalitz