gocolly
Looking for maintainers
I have nearly zero time to work on Colly nowadays. Please contact me if you'd like to help keep this project alive by managing issues and pull requests.
Thanks!
It's surprising how such an amazing framework has been dying. The only possible competitor to Scrapy !
@asciimoo Thanks for such an amazing effort ! A new release could attract both maintainers and users. I think anyone who sees that the last release was in 2020 immediately turns away.
I'm considering to apply to become a maintainer. Ideally together with more people.
It's surprising how such an amazing framework has been dying. The only possible competitor to Scrapy !
I agree and that would be a shame!
Thank you for the kind words. It's good to see that devs still consider using Colly. =) I've created a new release with the current codebase and updated dependencies: https://github.com/gocolly/colly/releases/tag/v2.2.0 .
I'm considering to apply to become a maintainer. Ideally together with more people.
@melroy89 It would be awesome. There is no obligation if you become a maintainer at all. Even if sometimes you have a little spare time to spend only on subjects you find interesting is better than nothing. =)
I'm considering to apply to become a maintainer. Ideally together with more people.
@melroy89 It would be awesome. There is no obligation if you became a maintainer at all. Even if sometimes you have a little spare time to spend only on subjects you find interesing is better than nothing. =)
I'm already a maintainer and also creator of several other big projects, as you can see on my github account. I believe a good crawler/scraper is important on the current web, and Python won't cut it for me. Golang is the way IMO. So I'm happy to help and support, I can review PRs and test and merge. Update dependencies and roll out new releases.
I have just one question left. I notice a sponsorship on your Readme about https://scrapfly.io/? How is this relationship going between Colly and Scraply? Are they still donating money or not?
Same for https://opencollective.com/colly#backer? What are you plans going forward with donations?
Great, thanks!
I have just one question left. I notice a sponsorship on your Readme about https://scrapfly.io/? How is this relationship going between Colly and Scraply? Are they still donating money or not? Same for https://opencollective.com/colly#backer? What are you plans going forward with donations?
Unfortunately Scrapfly cancelled their donations, but the opencollective page is up and running. Of course, I'm happy to compensate the effort put into maintaining Colly from the donations we receive, but be aware that it isn't that much currently (as I see it's around $4-$6/month).
Unfortunately Scrapfly cancelled their donations, but the opencollective page is up and running. Of course, I'm happy to compensate the effort put into maintaining Colly from the donations we receive, but be aware that it isn't that much currently (as I see it's around $4-$6/month)
Ok clear. I won't do it for the money, but I was genuinely interested in the current situation and moving forward.
Anyway, I'm ready when u are.
I want to continue being a co-maintainer (I still have "member" rights here), but I don't want to be alone :) Several patches of mine are still stuck since I can't review my own code.
I've been using Scrapy in my day-to-day job for almost 4 years now, and honestly, Colly is insanely fast, efficient, and cost-effective when you're running scrapers at scale. Just wanted to drop some appreciation here—huge props to the maintainers!