content-analysis-on-aws icon indicating copy to clipboard operation
content-analysis-on-aws copied to clipboard

Published 20 hours ago • verified publisher icon aws-solutions

Look into pagination options for ES calls from webapp

Open brandold opened this issue 6 years ago • 2 comments

This isn't part of your change. I noticed we are limiting the number of hits to return from Elasticsearch to 10000. If query results are truncated, we should indicate that to the viewer in the UI. I don't see that Elasticsearch _search API has a clear indication that results are truncated in the response. I think we should consider using the pagination ("scroll") in ES for our queries.

Originally posted by @aburkleaux-amazon in https://github.com/awslabs/aws-media-insights-engine/pull/76

brandold avatar Oct 31 '19 18:10 brandold

The limitation is 10,000, not 1000. Related to aws-solutions/aws-media-insights-engine#93

ianwow avatar Nov 04 '19 23:11 ianwow

I think we should also consider how much memory is being used by the front end to display the results and keep it in a certain bounds.

aburkleaux-amazon avatar Nov 05 '19 16:11 aburkleaux-amazon