webrecorder
[Bug]: YouTube crawling - approx half of all listed urls´ get a "Please update your Browser"-error
Browsertrix Version
v1.14.2-cb52da6
What did you expect to happen? What happened instead?
- When i crawl a list of YouTube URL´s almost half are crawled/reaches the youtube page the other gets something about not updated browser instead (see attached).
- If i recrawl the bad sseds half of them gets the error and half reach youtube (but are not crawled cause browser profile doesn´t work) see https://github.com/webrecorder/browsertrix/issues/2440
Reproduction instructions
-
Make a crawl of listed pages for YouTube (in this example only browser profile for cookie accept is used): https://app.browsertrix.com/orgs/kb-btrix/workflows/8ea8979c-8eb9-459d-a121-6fc9ecff5d23/crawls/manual-20250224123306-8ea8979c-8eb#config
-
Seeds i used for test:
-
https://www.youtube.com/watch?v=gVfXdeQqMUc&ab_channel=NikH https://www.youtube.com/watch?v=a_Mr-PI6vvA&ab_channel=NikH https://www.youtube.com/watch?v=oeuHS0N1jL0&t=155s&ab_channel=MortenSundgaard https://www.youtube.com/watch?v=mLt4Avy6CJ8&ab_channel=NicolaiJuul-Pedersen https://www.youtube.com/watch?v=69qLQseHjME https://www.youtube.com/watch?v=9QZlsub3VyM&pp=ygUYb3ZlcnN2w7htbWVsc2UgaSBkYW5tYXJr https://www.youtube.com/watch?v=wq-7XnUQUNc&pp=ygUYb3ZlcnN2w7htbWVsc2UgaSBkYW5tYXJr https://www.youtube.com/watch?v=P9JTes5Cvfs&pp=ygUYb3ZlcnN2w7htbWVsc2UgaSBkYW5tYXJr
-
Replay crawl (see attched)
Screenshots / Video
Environment
No response
Additional details
No response
