Cannot scroll through large User set (~45k Users)

[justas79]

There's a problem when trying to collect some data fro all users. I'm using scroll operation for ~45k users. I can no longer finish all scrolling operations due to failures in the middle of the scroll. Restarting scroll (on the next day) gives back "scroll already exists" error. I'm using single app for this. There exists few other apps on this workspace, however my scroll is used by single app only.

Version info

• intercom-java version: io.intercom:intercom-java:2.7.0
• Java version: 8

Expected behavior

Scroll through all users.

Actual behavior

Scrolling timeouts at a certain page. Restarting scroll gives back error scroll already exists for this workspace

Steps to reproduce

1. Start user scroll
2. Scroll fails at a certain page with errors like: a) io.intercom.api.IntercomException: Local exception calling [https://api.intercom.io//users/scroll?scroll_param=e768d820-1874-47a8-884b-9c3811c546a1]. Check connectivity and settings. [Read timed out] b) io.intercom.api.NotFoundException: scroll parameter not found

By checking timestamps it fails when response takes more than 1 minute

3. Starting new scroll on the next day gives back error: io.intercom.api.ClientException: scroll already exists for this workspace

Logs

io.intercom.api.NotFoundException: scroll parameter not found io.intercom.api.IntercomException: Local exception calling [https://api.intercom.io//users/scroll?scroll_param=e768d820-1874-47a8-884b-9c3811c546a1]. Check connectivity and settings. [Read timed out] io.intercom.api.ClientException: scroll already exists for this workspace