yt-dlc icon indicating copy to clipboard operation
yt-dlc copied to clipboard

[Question] Too Many Requests!

Open mbnoimi opened this issue 3 years ago • 8 comments

Checklist

  • [x] I'm asking a question
  • [x] I've looked through the README and FAQ for similar questions
  • [x] I've searched the bugtracker for similar questions including closed ones

Question

I still get HTTPError 429: Too Many Requests! although I use --sleep-interval 5 as shown below:

youtube-dlc --newline -i --force-ipv4 --age-limit 30 -R 99 --hls-prefer-native -o /home/laptop/Downloads/youtube-dl/downloads/Documentary/DW/%(title)s.%(ext)s -f mp4 --merge-output-format mp4 --write-sub --sub-format srt --sub-lang en --embed-subs --continue --sleep-interval 5 --download-archive /home/laptop/Downloads/youtube-dl/downloads/Documentary/DW/ytdl-archive.txt https://www.youtube.com/channel/UCET6sWl4Xcu-U8Ka9PJPrwA/videos

How can I bypass this issue?

UPDATE: youtube-dlc ver. 2020.11.7

mbnoimi avatar Nov 10 '20 14:11 mbnoimi

I have found that using cookies fixes the issue

pukkandan avatar Nov 10 '20 14:11 pukkandan

On a sidenote, channel extraction is currently broken. See https://github.com/blackjack4494/yt-dlc/issues/148

pukkandan avatar Nov 10 '20 14:11 pukkandan

I have found that using cookies fixes the issue

How can I do it (example please)?

mbnoimi avatar Nov 10 '20 14:11 mbnoimi

How can I do it (example please)?

https://stackoverflow.com/a/62213935

Ch4h3d avatar Nov 10 '20 15:11 Ch4h3d

Question

I still get HTTPError 429: Too Many Requests! although I use --sleep-interval 5 as shown below: How can I bypass this issue?

Send less requests, obviously 😆 Jokes aside. --sleep-interval is only dealing with audio/video downloads. If you download lots of subtitles you could use --sleep-subtitles as well - it should take some number as input.

What I have been experimenting with is actually to throttle the actual api requests that usually helps. But there is no parameter for that as of now and I am unsure whether this can be implemented globally or for youtube only (will need quite some work either way).
When I was fixing the history feed I noticed that when I reach 50-60 of 100+ pages it will return me some 429s. However when I put a 1-2s timeout in between each request I did not get any 429s.

For cookies you can use this https://chrome.google.com/webstore/detail/editthiscookie/fngmhnnpilhplaeedifhccceomclgfbg export as netscape

blackjack4494 avatar Nov 10 '20 16:11 blackjack4494

im getting same error (too many requests) by running this youtube-dlc -f 140 --embed-thumbnail 'https://www.youtube.com/playlist?list=RDCLAK5uy_kLWIr9gv1XLlPbaDS965-Db4TrBoUTxQ8' running version 2020.11.11-3 edit: cookies is the solution

IMIEEET avatar Nov 11 '20 15:11 IMIEEET

Why do you get that error?

idk but maybe bcz of my vpn(before that yt showed me that capcha thing).

IMIEEET avatar Nov 12 '20 13:11 IMIEEET

I found why, is is because you have downloaded for extensive amount of times, so you are getting a warning (too many requests) It just happened with me right no, so slow down the download or change the ip address using a vpn, that way you have to do a good amount of download before you get another warning for that up address and so on

you dont have to download a lot for this to happend. its VPN. many users may get same ip. maybe they are doing a lot of downloads and this will happend to everyone who is connected to same vpn server and using google services. anyway i have to use vpn to access yt since its censored/sanctioned here. i have to reconnect another server when this happens

IMIEEET avatar Nov 13 '20 11:11 IMIEEET