Awesome-Python-Scripts icon indicating copy to clipboard operation
Awesome-Python-Scripts copied to clipboard

Add Some Cool Web-Scraping Scripts

Open powerexploit opened this issue 5 years ago • 53 comments
trafficstars

This is a easy and medium level Issue.

  • Web scraping is data scraping technique used for extracting data from websites.
  • Try to add some basic and advance web scraping scripts in Web-Scraping folder.

Comment on the issue and start contributing

powerexploit avatar Aug 14 '20 06:08 powerexploit

I would like to work on this issue for adding a Web scraping script using python. @ankitdobhal

sameersrivastava13 avatar Aug 14 '20 07:08 sameersrivastava13

I would like to work on this. @ankitdobhal

kaustubhgupta avatar Aug 14 '20 08:08 kaustubhgupta

I would like to work on this too @ankitdobhal

twishabansal avatar Aug 14 '20 08:08 twishabansal

@ankitdobhal assign me as (M)

Neilblaze avatar Aug 14 '20 08:08 Neilblaze

I would like to work on this issue for scraping Hacker news website @ankitdobhal

GudlaArunKumar avatar Aug 14 '20 09:08 GudlaArunKumar

I have a repo of web scraping using python u can assign me for this

Saicharan67 avatar Aug 14 '20 11:08 Saicharan67

Me & Ankit are the respective mentors of this issue.

@sameersrivastava13 @kaustubhgupta @twishabansal @GudlaArunKumar @Saicharan67 Feel free to work upon this. Try to maintain clean code protocol & always follow contributions guide.

If anyone gets stuck, drop me a private message at slack or just mention me over here! Best of luck everyone :heart: Happy Contributing :tada:

Neilblaze avatar Aug 14 '20 11:08 Neilblaze

Hi @ankitdobhal and @Neilblaze, I have a web scraping idea to scrape weather website(s) to collect live weather conditions, given a location. Could you please assign me to this issue? Thanks :)

PatelKeviin avatar Aug 14 '20 13:08 PatelKeviin

@PatelKeviin Assigning are done to the mentors, the corresponding mentees are instructed to follow the guide & create a PR regarding their contibution. If you get stuck, just ping me on slack or mention me here.

Neilblaze avatar Aug 14 '20 14:08 Neilblaze

@Neilblaze Ohh, thanks for the clarification. Does that mean I can contribute to this issue?

PatelKeviin avatar Aug 14 '20 22:08 PatelKeviin

@Neilblaze Ohh, thanks for the clarification. Does that mean I can contribute to this issue?

@PatelKeviin If you are participant in CH20 for this project you can contribute . I will take PR for CH20 contest participant for this project. Even if you want to contribute you can. Thanks

powerexploit avatar Aug 15 '20 05:08 powerexploit

@ankitdobhal I would like to contribute to this issue too!

sanusoumya17 avatar Aug 15 '20 06:08 sanusoumya17

@ankitdobhal I would like to contribute to this issue.

Nagasuruthika avatar Aug 16 '20 05:08 Nagasuruthika

Hi @ankitdobhal I would like to contribute in this issue and add some scripts to scrape DL information given only the basic inputs. Please assign me in.

TechTarun avatar Aug 16 '20 05:08 TechTarun

@sameersrivastava13 @kaustubhgupta @twishabansal @GudlaArunKumar @PatelKeviin @sanusoumya17 @Nagasuruthika @TechTarun contribution period starts from today :tada:

You guys can now submit your PR's. I i.e. @Neilblaze am the Mentor of this project.

The corresponding mentees are instructed to follow the guide & create a PR regarding their contibution. If you guys get stuck at any point, mention me here or in slack dm or if critical, then create an issue & state your problem briefly over here.

May the source be with you! :muscle: Happy Contributing :rocket:

Neilblaze avatar Aug 16 '20 07:08 Neilblaze

@PatelKeviin Assigning are done to the mentors, the corresponding mentees are instructed to follow the guide & create a PR regarding their contibution. If you get stuck, just ping me on slack or mention me here.

@TechTarun see this!

Neilblaze avatar Aug 16 '20 07:08 Neilblaze

@Neilblaze Hi I have raised PR #105. Please review and let me know if any changes required.

GudlaArunKumar avatar Aug 16 '20 10:08 GudlaArunKumar

@Neilblaze Hi I have raised PR #105. Please review and let me know if any changes required.

I have requested changes on it! Please go through it :)

Neilblaze avatar Aug 16 '20 10:08 Neilblaze

I would like to work on a script which can be used to download articles from Medium

Namyalg avatar Aug 16 '20 11:08 Namyalg

I would like to work on a script which can be used to download articles from Medium

Sure @Namyalg . Go for it! :+1:

Neilblaze avatar Aug 16 '20 11:08 Neilblaze

Also, don't forget to add this line while creating your PR ⬇ In reference to - #92 so that the PR link gets clipped with this issue!

Have Fun :smile: & Best of Luck everyone :tada:

Neilblaze avatar Aug 16 '20 12:08 Neilblaze

I would like to work on web scraping @ankitdobhal @Neilblaze . Please assign me to this issue

harshareddy794 avatar Aug 16 '20 13:08 harshareddy794

@PatelKeviin Assigning are done to the mentors, the corresponding mentees are instructed to follow the guide & create a PR regarding their contibution. If you get stuck, just ping me on slack or mention me here.

@harshareddy794 see this!

Feel free to work, submit your pr & follow the contribution guidelines!

Neilblaze avatar Aug 16 '20 13:08 Neilblaze

@ankitdobhal I would like to work on this issue

amandp13 avatar Aug 16 '20 17:08 amandp13

@Neilblaze I have raised PR #125 . Let me know if you have reviewed it 😅.

kaustubhgupta avatar Aug 17 '20 02:08 kaustubhgupta

I have added a covid-19 webscrapping file which webscrapes a file and stores the data in the csv format for future processing please review it #139

Adityanagraj avatar Aug 17 '20 07:08 Adityanagraj

I would like to work on web scraping @ankitdobhal @Neilblaze . Please assign me to this issue

Requested changes on the PR. Please go through it!

Neilblaze avatar Aug 17 '20 07:08 Neilblaze

@ankitdobhal I would like to work on this issue

Sure @amandp13 . Go for it! :+1:

Neilblaze avatar Aug 17 '20 07:08 Neilblaze

@Neilblaze I have raised PR #125 . Let me know if you have reviewed it .

Requested changes on the PR. Please go through it!

Neilblaze avatar Aug 17 '20 07:08 Neilblaze

This is a humble request to all the participants:

  • Please ensure you explain every section of your code properly before giving Pull Requests.
  • Create a separate branch before creating a PR.
  • The title of the Pull Requests should be appropriate.
  • Please do not forget to link the issue!
  • You might split the work for an issue among yourselves but please do not quarrel for claim of work. The aim of this program is to collaborate. There will always be a lot to improve even if someone else takes up your work!
  • You are free to give suggestions regarding the project. However the say of the mentors and the project admins shall be considered final to meet the requirements of the project.
  • For common doubts, please post it in the channel, so that even if one mentor/admin is not available, other's can help you out and later if someone has the same confusion, they would be covered too.
  • If you wish to add a new feature, just open an issue and give information regarding that, like why it is needed and what can be done to achieve the goal!

The mentors are requested to ensure these are followed during the contribution period.

Neilblaze avatar Aug 17 '20 08:08 Neilblaze