Trying to download an episode from crunchyroll results in a 403

[TimyIsCool]

Checklist

• [x] I'm reporting a broken site support
• [x] I've verified that I'm running youtube-dl version 2021.12.17
• [x] I've checked that all provided URLs are alive and playable in a browser
• [x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
• [x] I've searched the bugtracker for similar issues including closed ones

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--username', 'PRIVATE', '--password', 'PRIVATE', '--verbose', 'https://www.crunchyroll.com/watch/GZ7UVJ8PK/i-got-a-girlfriend']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2024.04.08 [e0727e4ab] (single file build)
[debug] ** This version was built from the latest master code at https://github.com/ytdl-org/youtube-dl.
[debug] ** For support, visit the main site.
[debug] Python 3.4.4 (CPython AMD64 32bit) - Windows-10-10.0.22621 - OpenSSL 1.0.2d 9 Jul 2015
[debug] exe versions: ffmpeg 6.0-full_build-www.gyan.dev, ffprobe 6.0-full_build-www.gyan.dev
[debug] Proxy map: {}
[generic] i-got-a-girlfriend: Requesting header
WARNING: Could not send HEAD request to https://www.crunchyroll.com/watch/GZ7UVJ8PK/i-got-a-girlfriend: HTTP Error 403: Forbidden
[generic] i-got-a-girlfriend: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://github.com/ytdl-org/youtube-dl/issues , using the appropriate issue template. Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose option and include the complete output.
  File "D:\a\ytdl-nightly\ytdl-nightly\youtube_dl\extractor\common.py", line 679, in _request_webpage
  File "D:\a\ytdl-nightly\ytdl-nightly\youtube_dl\YoutubeDL.py", line 2465, in urlopen
  File "C:\hostedtoolcache\windows\Python\3.4.4\x86\lib\urllib\request.py", line 470, in open
  File "C:\hostedtoolcache\windows\Python\3.4.4\x86\lib\urllib\request.py", line 580, in http_response
  File "C:\hostedtoolcache\windows\Python\3.4.4\x86\lib\urllib\request.py", line 508, in error
  File "C:\hostedtoolcache\windows\Python\3.4.4\x86\lib\urllib\request.py", line 442, in _call_chain
  File "C:\hostedtoolcache\windows\Python\3.4.4\x86\lib\urllib\request.py", line 588, in http_error_default

Description

I have tried both the release and nightly build(2024.04.08) and it gives the same output. I checked my username and password and the site works fine yet the downloader doesn't work I tried with no VPN and with cloudflare warp

[october262]

does download still fail if you use authenticated cookies ??

[TimyIsCool]

does download still fail if you use authenticated cookies ??

Not sure on how to get cookies but I found yt-dlp which I managed get working

[dirkf]

The yt-dl extractor is now obsolete. The site switched to a new format that was already handled by yt-dlp's CrunchyrollBetaIE. Some further changes were made quite recently.

Good news: it seems that my ad hoc back-port of the latest yt-dlp code reproduces the behaviour of that code.

Bad news:

• the back-port involves updating some core APIs, so I'll take some care pushing the changes
• it's very difficult to use the site because of its paranoid bouncer aka Cloudflare and/or the need for an account
• even more, automated download testing is almost impossible.

I will put up a core PR, that doesn't have these problems, and then an extractor PR that in principle should resolve this and other open CR issues to the extent that the site allows.

yt-dlp users may have a less irritating experience with this site and other that demand cookies because of --cookies-from-browser ..., a feature that I don't intend to include here.

[Tama47]

yt-dlp users may have a less irritating experience with this site and other that demand cookies because of --cookies-from-browser ..., a feature that I don't intend to include here.

That was recently removed for the Crunchyroll extractor.

[dirkf]

Indeed, the site only works consistently after logging in with username and password.