workload-discovery-on-aws icon indicating copy to clipboard operation
workload-discovery-on-aws copied to clipboard

Add Pagination to GetAccounts query

Open svozza opened this issue 2 years ago • 0 comments

After implementing the AWS Organization integration, there will be users who may have thousands of accounts in their org that will be imported by the discovery process. This greatly increases the chance that we will exceed the lambda payload limit when returning the list of accounts on the frontend. As the accounts are store in DynamoDB we cannot use the same pagination strategy as our other APIs and must instead use LastEvaluatedKey field detailed in the DynamoDB docs. This will impact on #396, as moving the organizations:ListAccounts API calls to the Settings lambda could cause rate limiting issues when calling that API repeated during paged requests.

svozza avatar Mar 18 '23 09:03 svozza