Ondra Urban
Ondra Urban
I monitored it some time ago and the scaling itself works quite well in preventing a sudden crash. A problem arises when the load is very high all the time,...
Although I must add that I’m using the Pool for some highly intensive processing tasks that run through tens of thousands of tasks in minutes and it never had a...
Do we really need such an edge case in the SDK though?
Sure @robintom, go ahead. Try to first prepare some proof of concept with plain Puppeteer and we can guide you through integration into the SDK later. Thanks and good luck!
@cybairfly To be able to unpair session creation from session consumption. With this option, you could have an actor that creates the sessions and periodically persists them into KVS and...
> Ideally, I'd like the pool to be a in a "pick only" mode, aka, a "do not mutate". So you want the KV pool to be left untouched even...
It's based on the API architecture of Apify Platform, but we've debated adding some syntax sugar for local usage for a long time so we might just add this.
@mvolfik so this does not apply? [From docs.](https://sdk.apify.com/docs/api/pseudo-url#__docusaurus)
Interesting. Well, I wouldn't worry about it for v2. Apparently nobody needed it until now 😄
Yeah, this is long overdue and we still have not found the time to add those features. A better, although a similarly awkward workaround as editing the `crawler_utils.js` would be...