got-scraping icon indicating copy to clipboard operation
got-scraping copied to clipboard

HTTP client made for scraping based on got.

Results 17 got-scraping issues
Sort by recently updated
recently updated
newest added

It seems to me that the library does not work correctly over the http/2 when using a proxy. Each request create a new agent, which, in turn, create of a...

t-tooling

I'd like to use [hpagent](https://github.com/delvedor/hpagent) because it supports reusable sockets. I tried passing in `agent: { https: httpsAgent }` but it was overridden / didn't work. I'm wondering if this...

t-tooling

Hello! I don't know if that's a misunderstanding from my side, but when I set http2: false, my server still receive alpn h2, and lowercased headers. How to fully go...

t-tooling

is there a way to override per-request header casing (e.g choosing a uppercase for a single header even when http2) ?

t-tooling

Hello! I encountered the following error, using jest and typescript. Cannot find module 'got-scraping' from 'src/shared/extractor/html-loader.ts' As you can understand, I have module that works in application well, but inside...

t-tooling

Hey! First off all thanks for this amazing package! As the title suggests, is there any way to set the proxyUrl through the beforeRequest hook? Ideally I'd like to do...

Node v18 removed the OpenSSL option to accept legacy servers. This causes Got to throw the following error when scraping servers that don't support RFC 5746 secure renegotiation: `RequestError: C0B70F932E7F0000:error:0A000152:SSL...

Recently I have encounter some changes In Cloudflare antibot protection. While using got-scraping, I am now unable to send requests to websites protected by Cloudflare.I have to use Puppeteer to...

t-tooling

This could be coming from here: Reported: https://apifier.slack.com/archives/C0L33UM7Z/p1672908415370339

bug
t-tooling