OpenScraper
OpenScraper copied to clipboard
An open source webapp for scraping: towards a public service for webscraping
*pause spider* : - [ ] add in parsing : update `spider_config/log` - [ ] add field `is_paused` in `spider_config/log` - [ ] update which page / which item spider...
Need to implement a way to : - [ ] flag all existing passwords as not hashed - [ ] hash the passwords at register and flag pwd as hashed...
- [ ] change print statements - [ ] change venv to python 3 venv local check : http://python-future.org/compatible_idioms.html
The "view x items" page does not seem to provide the full summary, only pieces
The more conventional writing is "address"
So it can be easily copied from a machine to another
So it can be easily copied from a machine to another
Unless I'm mistaken, I noticed that user passwords are stored unobfuscated in the database. It looks like a [quite annoying issue](https://www.developpez.com/actu/234551/RGPD-le-reseau-social-allemand-Knuddels-de-condamne-a-payer-une-amende-de-20-000-pour-avoir-stocke-des-mots-de-passe-en-clair/). Passwords should be salted and hashed using a [bruteforce...