product-backlog icon indicating copy to clipboard operation
product-backlog copied to clipboard

Change Elasticsearch settings to restore annotation count displays > 10k on Activity Pages

Open mkdir-washington-edu opened this issue 1 year ago • 1 comments

The problem

With the Elasticsearch upgrade there are default limitations on calculating the number of annotations a particular user has, with performance tradeoffs for allowing calculations over 10k. By default the result for counts over 10k is just "more than 10k". For users with many annotations this has affected that counts that show up in the Activity Pages.

The solution

Enable the feature in our new version of Elasticsearch to allow counts of annotations in excess of the current amount. We may want to consider finding the publicly available counts of some of our super users if we want to find a new upper bound we're willing to calculate.

mkdir-washington-edu avatar Jan 06 '25 18:01 mkdir-washington-edu

Slack thread with original context and technical discussion around ES 6 -> 7 changes: https://hypothes-is.slack.com/archives/C2BLQDKHA/p1734649457476149

robertknight avatar Jan 06 '25 19:01 robertknight

Might be a few days work to try something and see if it works.

mkdir-washington-edu avatar May 22 '25 15:05 mkdir-washington-edu