Charlie Orford

…s be a string of 0s regardless of actual file contents (length will be as specified with the hashLength option). Why? When developing, it's useful to be able to force...

Documentation for mixed mode crawls

7

The SDK examples for each crawler type (Basic, Cheerio, Puppeteer) assume running an entire crawl with just that crawler. In many cases, it is often desirable to use a browser...

Use Okta Authentication API to acquire session token and add support …

2

…for "push" MFA challenges e.g. via Okta Verify

Puppeteer v14.4.0 (and higher) broken when using puppeteer-extras

16

`browserController.newPage()` fails with "Cannot read private member from an object whose class did not declare it" when used with `puppeteer-core` v14.4.0+ and `puppeteer-extra` v3.3.0 (with `puppeteer-extra-plugin-stealth` v2.10.1). Seems to be...

header-generator fails luminati botcheck

5

### Describe the bug Multiple header and TLS tests fail when visiting: https://botcheck.luminati.io/ ### To Reproduce - got-scraping `3.2.13` - header-generator `2.1.17` - crawlee `3.3.0` - ubuntu `focal` **Headers present...

Passing SSL_OP_LEGACY_SERVER_CONNECT down to Node

2

Node v18 removed the OpenSSL option to accept legacy servers. This causes Got to throw the following error when scraping servers that don't support RFC 5746 secure renegotiation: `RequestError: C0B70F932E7F0000:error:0A000152:SSL...

Works with Windows 10 (build #14942 or higher) and Windows Subsystem for Linux

5

Microsoft recently added inotify support to their Windows Subsystem for Linux (see: https://blogs.msdn.microsoft.com/commandline/2016/10/07/wsl-adds-inotify-filesystem-change-notification-support/). Happy to report running `notify-forwarder watch` via bash on the windows host and `notify-forwarder receive` on the...