Kevin Nobel
Kevin Nobel
I wrote a decorator to automatically register crawler functions and slightly simplified the crawler code and data structure. I believe this will make adding new crawlers to Argostimè easier for...
- When a product has multiple options the crawler detects the wrong price, [example](https://www.hema.nl/wonen-slapen/slapen/dekbedden/zomerdekbed---bamboe-wit-1000014201.html) - 1+1 gratis is not detected, [example](https://www.hema.nl/mooi-gezond/persoonlijke-verzorging/zonnebrand/zonnemelk-spf30---200ml-11610232.html). - Some characters are not parsed in the correct...
I discovered that the Etos crawler cannot detect some discounts, they possibly added new types of discounts. Types of discounts that do not work that I have found are: -...
An EAN code uniquely identifies the product. Therefore if we find an EAN code at different shops, we know they are selling the same product! Some products are already linked...
There is a bug in the AH scraper. When a product is marked as being on discount next week, it is not parsed correctly. Examples: - https://argostime.mrtijn.nl/product/wi510587 - https://argostime.mrtijn.nl/product/wi93224 -...
I found out that [pre-commit](https://pre-commit.com/) is very nice! We can also enable [this](https://pre-commit.ci/) in the future. Also this is still a work in progress...
It takes a very long time to load the Albert Heijn page: https://argostime.mrtijn.nl/shop/1 I think we might be able to fix this using a more clever SQL query or adding...