scrapy.dart icon indicating copy to clipboard operation
scrapy.dart copied to clipboard

Its Support

Open amanv8060 opened this issue 5 years ago • 6 comments
trafficstars

Its been a long time since it was last updated . Will you maintian it or it is archived? i need to scrape dynamic website , i can do that in python with selenium and beautiful soup . How to do in flutter?

amanv8060 avatar Aug 29 '20 11:08 amanv8060

Hey @amanv8060! Sorry I've been busy with other things. A couple of months ago I started a revamp of the project, also I wanted to rebrand it, would you be ok with that? I have an idea how to solve your problem but do you have an example website in mind that requires a web browser to scrape that I can use as an integration example?

sachaarbonel avatar Sep 21 '20 06:09 sachaarbonel

Hey @amanv8060! Sorry I've been busy with other things. A couple of months ago I started a revamp of the project, also I wanted to rebrand it, would you be ok with that? I have an idea how to solve your problem but do you have an example website in mind that requires a web browser to scrape that I can use as an integration example?

Hi! ^^ Are the Todos still relevant? Would it be useful if I wrote tests or the link extractors?

dharmadeveloper108 avatar Oct 03 '20 22:10 dharmadeveloper108

Hi @dharmadeveloper108 feel free to submit write some tests I'd be happy to review a PR. Same goes for the links extractor, I thought of something like extract all a href, that match the ongoing domain probably using Regex

sachaarbonel avatar Oct 03 '20 23:10 sachaarbonel

Awesome 😄👍 I'll get to it then

dharmadeveloper108 avatar Oct 03 '20 23:10 dharmadeveloper108

If it is for hacktoberfest shouldn't I put a label or something? I saw something like that on Twitter but I'm not sure

sachaarbonel avatar Oct 03 '20 23:10 sachaarbonel

Personally I would like to work on it regardless of the month (I don't think I'll participate in hacktoberfest), but if you want then yes, I think you can add a label. Just beware of the spammy PRs 😬 seems like it's a bit of a problem with this year's edition (https://twitter.com/MattIPv4/status/1311421301291200512).

dharmadeveloper108 avatar Oct 04 '20 00:10 dharmadeveloper108