Using async wisely

[VerusK]

This PR addresses a critical issue encountered when scraping large websites with over 1 million pages. Previously, goroutines were being spawned without any limit, leading to significant memory bloat. This update introduces a more efficient management system for goroutines, effectively resolving the memory issues.

Regarding this issue https://github.com/gocolly/colly/issues/381