Crinibus
Crinibus
Add field ```request_timeout``` under section ```Scraping``` in config file ```settings.ini``` Add static method ```Config.get_request_timeout``` to get request timeout from config file ```settings.ini``` - if ```request_timeout``` is not a number then...
Visualize how many products have been scraping and how many is still left to go. Possible libraries: - [progressbar2](https://github.com/WoLpH/python-progressbar) - [alive-progress](https://github.com/rsalmei/alive-progress) - [tqdm](https://github.com/tqdm/tqdm)
Move number of seconds for requests from function ```request_url``` into file ```settings.ini``` to be easier to change.
Update so that scraping at different domains can happen at the same time, but scraping a each domain is sequentially E.g. if there is four products to be scraped from...
Add a progress bar when scraping Issue: #180
**Tech scraper** visualize_data.py: - When viewing graph, then show highest and lowest price for each domain somewhere on the graph, maybe under the title. - Maybe also the median or...