node-anime-viewer icon indicating copy to clipboard operation
node-anime-viewer copied to clipboard

[Bug] Throttling problem

Open asdfugil opened this issue 3 years ago • 6 comments

So, it looks like if you download too much with you get throttled to hell

But then going to the actual site and use inspect element to get the file url and referer and download it with curl using user agent 'jdjfirjrj/1' did not get throttled (super fast).

Using ani-cli download also has decent speed, depsite not being very fast.

asdfugil avatar Jan 09 '22 01:01 asdfugil

It might be problem of server, some server are really slow and takes long time to download.

MeemeeLab avatar Jan 11 '22 16:01 MeemeeLab

On my testing I did not get throttled.

MeemeeLab avatar Jan 11 '22 16:01 MeemeeLab

It happenes after I downloaded about 35 episodes

asdfugil avatar Jan 12 '22 05:01 asdfugil

OK so I tried download another anime today and the throttle happened after downloading only 11 episodes. It went from taking a few seconds to download an episode to 2 hours.

asdfugil avatar Jan 30 '22 04:01 asdfugil

Plus the throttling happens in the middle of downloading another episode so it must be an intentional throttle.

asdfugil avatar Jan 30 '22 04:01 asdfugil

curl with user agent + referer did not get throttled.

But even in the curl command I only used the https://example.com referer header, not the actual referer.

asdfugil avatar Jan 30 '22 04:01 asdfugil