Aerie Gateway Upload Large Dataset Loop

[duranb]

Checked for duplicates

Yes - I've already checked

Is this a regression?

No - This is a new bug

Version

develop

Describe the bug

Gateway is getting stuck in a loop when the user uploads an dataset file to /uploadDataset that contains a large number of profiles in a single file. The reason is that we place a limit on the query payload that gateway makes to hasura. That file size is determined by the number of profiles and the number of segments in each profile. The loop occurs when that limit is immediately reached by just instantiating the payload with all of the profiles even without the segments.

Reproduction

To repro, attempt to upload a dataset with at least 1000 profiles present.

Logs

System Info

Chrome

Severity

Moderate