twitterscraper icon indicating copy to clipboard operation
twitterscraper copied to clipboard

A serial mode without using Pool

Open axnsantana opened this issue 4 years ago • 1 comments

Including an option to run the scrapper in a serial mode without use Pool. The use of Pool is not available in environments like AWS Lambda (#114).

The mode selection uses the previous idea that if poolsize greater than 1, then run in parallel.

I am currently using this in a serverless application in AWS Lambda. The lambda function can be invoked multiple times to mitigate the loss of performance, simulating a parallel execution.

axnsantana avatar Apr 09 '20 15:04 axnsantana

i have similar issue when run pool inside standard Thread...

lukaspistelak avatar Jun 23 '20 16:06 lukaspistelak