Throttling pagination

[JonnyBGod]

I am trying to crawl / scrape a list using pagination. Problem is that I get a "too many request" error after a few seconds.

How can we throttle paginations?

Placing a delay after paginate is not helping, the pagination keeps going and just delays the set command.

[simonwjackson]

I made a quick and dirty change to the pagination method in my fork, just to get this working.

paginate(selector, limit, sleep)

I haven't done extensive testing, but it works well for my application.

https://github.com/simonwjackson/node-osmosis/commit/b279d9e6317f4e31edd0eaaa8c914db067cb9302

[hjalmarsn]

Was this ever fixed in the original code?

[akarabach]

Any update here ?