[QUESTION] Request rate limiting

[Unbrick]

Hey guys,

i have been experimenting with this scraper for about a week now. Basically it works like a charm, but i'm a little confused about the request rates possible. My setup uses a phone verified instagram account (through a private proxy) which automatically completes the 2 factor authentication using SMS (also through the proxy, IPs should be identical).

When requesting 5000 media items of one instagram page, the requests are split internally in 12 media items per request. Rate limiting does not seem to kick in here.

My issue pops up after requesting media (independent of the count, does not matter if 50 or 5000) of any instagram page. Scraping one page works like a charm, subsequent page scrapes will throw an error:

InstagramException: Response code is 403. Body: {"message": "login_required", "error_title": "You've Been Logged Out", "error_body": "Please log back in.", "logout_reason": 2, "status": "fail"}

Logging in again does work (no two factor reqired) but i cant log in for every page i scrape as logging in rate limits at 8-10 times in a short period of time.

Has anyone a simmilar behaviour or knows what the issue here is?