browsertrix icon indicating copy to clipboard operation
browsertrix copied to clipboard

[Bug]: Browser profile for logged in YouTube not working during crawl/replay

Open Klindten opened this issue 1 year ago • 2 comments

Browsertrix Version

v1.14.2-cb52da6

What did you expect to happen? What happened instead?

I expected to be able to crawl with browser profile logged in to YouTube Premium, but instead i got the following during crawl/replay: "Log ind for at bekræfte, at du ikke er en bot"/ Log-in to confirm you are not a bot.

Reproduction instructions

  • Make a Browser profile - logged in to YouTube Premium (with 2 factor authentication)
  • Double check that it works by viewing "Configure Crawling Profile"
  • Crawl YouTube URL... like https://www.youtube.com/watch?v=80y5uZd6I8k
  • Observe error: "Log ind for at bekræfte, at du ikke er en bot"/ Log-in to confirm you are not a bot during replay (and crawl)

https://app.browsertrix.com/orgs/kb-btrix/workflows/8ea8979c-8eb9-459d-a121-6fc9ecff5d23/crawls/manual-20250224123306-8ea8979c-8eb#replay

Screenshots / Video

Image

Environment

No response

Additional details

If I add the 2 urls and not 1 hop out with the browser profile it works - maybe v1.14.2-cb52da6 fixed this bug....

No response

Klindten avatar Feb 28 '25 11:02 Klindten

Right now it seems like v1.14.2-cb52da6 fixed this bug....

Klindten avatar Feb 28 '25 13:02 Klindten

But not anymore..

on version: v1.14.3-9466e83

Trying to get logged in content and double check that it works by viewing "Configure Crawling Profile" i get this during crawl and playback:

Image.

In former crawls I have seen half of the pages in the URL list get crawled with logged in profile and the other half get the "Update Your Browser"-page. Screenshot From 1.4.1 something on our local install -see also https://github.com/webrecorder/browsertrix/issues/2441

Image

Klindten avatar Mar 04 '25 16:03 Klindten