minet
minet copied to clipboard
medialab
A webmining CLI tool & library for python.
Subsumes #763 & #740 - [x] -m - [x] -e - [x] Add -s support for -m (related to casanova.inferring_writer enhancements). - [ ] --field - [x] Function scraper could...
https://linktr.ee/expedia The json payload is very easily grabbable.
We could also register all the urls in the stack but it might get a little costly.
Also test connection draining. This info should probably be passed along to `BufferedResponse`.