Ondra Urban
Ondra Urban
cc @jancurn
Yeah, that certainly makes sense. @metalwarrior665 would you by chance have any code that we could quickly turn into an example?
It should not be difficult to do for `Cheerio`, but it might be problematic with `Puppeteer` and `Playwright`, since the DOM elements actually exist only in the browser, not in...
Related: https://github.com/apifytech/apify-js/issues/321
Great kick-off. I pretty much agree with everything. Here are a few notes of my own. The number one thing users hate about our error management is the "internal" logging...
CheerioCrawler only gets access to the request and starts manipulating cookies after redirects. This could be deeper. @szmarczak `got-scraping` maybe? We will look into this. Definitely a bug.
Hah, nice catch @pocesar. It indeed does display the cookies when `set-cookie` is used. Might have nothing to do with how we handle cookies, but we should investigate anyway. Maybe...
I only gave it a minute, so I'm sure I missed things. We will investigate this for sure.
I think we never really thought about redirect cookies so this is an omission on the SDK end. We wrongly assumed that redirect cookies would be sent by `got`, if...
Technically, the `AutoscaledPool` should not allow the overloading to happen and downscale accordingly when any API is overloaded. So if you're simply pushing to dataset once per request, the pool...