herd
herd copied to clipboard
UI and REST - View filtered BData Search results with minimal delay
As a Big Data Developer I want to provide filters in BData Search results that might match lots of results but still get results rapidly.
Functional Notes:
- BData Search will no longer be used to produce the initial, unfiltered results on the BData List page of the UI. Instead, Get All BData will be used at that time. As soon as the user applies a filter, then BData search will be used.
- This change is for performance reasons.For example, an attribute search on partial value match could match hundreds of thousands of BData in certain BDef. If there is not a limit to size of results, sort performs too slowly.
Acceptance Criteria
- BData Search limit is increased to 1000. This should be a configurable value and will be tuned during performance testing
- BData Search endpoint will return 400 code if limit exceeded
- If limit of 1000 is exceeded, no Toast error on UI. User does not receive results - but instead receives non-scary looking message "Result limit of 1000 exceeded. Total result size 15768. Modify filters to further limit results"
- If limit is not exceeded, result count shows as "Displaying 453 results"
- Performance tested to ensure no significant impact on performance or resource utilization
- Performance goal of ~5 seconds to render results.
Tech Note - use existing Attr search performance testing and/or additional generated data registered in another storage to the S3 part is not necessary