web_scraper
web_scraper copied to clipboard
Mainthread blocking.
The library parsing and doing all things on main thread. which slows down the all app
Are you using the async functions for all events?
sure. but i need it at scale, so im parsing like 36 pages at the same time and its blocking the thread a little bit.
also the way its working is not best for performance. becasue when the message of the parsing is getting to the event loop so its stucking till all parsing end. its not as chunk mechanism or separate isolate
Agreed. It could be a valid improvement to do.