botasaurus icon indicating copy to clipboard operation
botasaurus copied to clipboard

Parallelization using tabs

Open mighty-phoenix opened this issue 1 year ago • 0 comments

Currently using the browser decorator with async_queue, parallel params helps with parallelization of scraping tasks by opening n number of separate browser instances. Can we also parallelize such scraping using tabs in a single browser instance easily and with automatic management? Say by a newly introduced param in the browser decorator like parallel_tabs? This would be an amazing functionality to have, and could reduce CPU utilization significantly. Quick response would be highly appreciated. Thanks! @ChetanJainSirsa @Chetan11-dev @Chetan11-dev @noreply @iamdevdiv @Allamaris0

mighty-phoenix avatar Oct 12 '24 05:10 mighty-phoenix