privacy-bot icon indicating copy to clipboard operation
privacy-bot copied to clipboard

Identify related projects

Open ecnmst opened this issue 7 years ago • 4 comments

The idea is to collect in the same place projects we have related interests with, so that we reach out to collaborate. The following projects for instance are related:

  • https://github.com/edgi-govdata-archiving/web-monitoring
  • https://tosdr.org/

ecnmst avatar May 31 '17 09:05 ecnmst

Hey, Web Monitoring seems to share a lot of the goals we have, and face the same issues. They also have a nice thread where they listed existing projects/packages that can be used some of the issues we face: https://github.com/edgi-govdata-archiving/web-monitoring/issues/18

It's probably worth a look, and we should probably talk to them as well!

remusao avatar Jun 01 '17 07:06 remusao

Here there's a project for web monitoring written in Python that gives some good ideas about system notifications and maybe it can inspire us for our bot: https://github.com/thp/urlwatch

YunitoMH avatar Jun 01 '17 08:06 YunitoMH

That might be interesting as well: https://github.com/ikreymer/pywb

pywb allows high-quality replay (browsing) of archived web data stored in standardized ARC and WARC, and it can also serve as a customizable rewriting proxy to live web content.

remusao avatar Jun 01 '17 09:06 remusao

Project with a lot of tools for Web Scraping in Python (And other languages). I think it's very useful and can help us to solve some problems that might occur: https://github.com/lorien/awesome-web-scraping/blob/master/python.md

YunitoMH avatar Jun 01 '17 11:06 YunitoMH