David Hicks
David Hicks
There is possibly a new store finder behind this, being Storelink @ https://www.storelink.co.nz/ I'm not sure if it's worth implementing this store finder until more examples can be found of...
@iandees Looks like the new CodeBuild CI system needs to have Playwright installed correctly?
@iandees To help with merging prior to Playwright being fixed with AWS CodeBuild, I've provided output from this new spider below: ``` {'atp/brand/Shoprite': 492, 'atp/brand_wikidata/Q1857639': 492, 'atp/category/shop/supermarket': 492, 'atp/field/city/missing': 1,...
Something like this: ``` from locations.storefinders.store_locator_plus_self import StoreLocatorPlusSelfSpider class SeafoodCitySpider(StoreLocatorPlusSelfSpider): name = "seafood_city" item_attributes = { "brand_wikidata": "Q7440359", "brand": "Seafood City", } searchable_points_files = [??] search_radius = ?? max_results =...
Do we need to add to stats as well as raising an INFO log? For example: ``` ... atp/antibot/azure_waf: True atp/antibot/human: True ... ```
> This seems sensible. Thinking about your auto detection branch, could this annotate spiders to automatically use a proxy? And I guess second question, should it? I think this anti-bot...
All stores in XML format at https://www.lasirena.es/ca/stores?ajax=1&all=1
HTML parsing required with all location data seemingly on the same page https://www.sas.am/about/our-supermarkets/: ``` 24/7 Մաշտոցի 18 +374 (10) 53-93-99 ```
I feel like we haven't yet figured out the API syntax yet. So far I've found: - `search` must be in the format of `CityName, StateAbbreviation, CountryAbbreviation` for the US...
And `maps.levi.com` is an example of where a `search=..` parameter is not required, and all results can be returned with no search query. Some brands using RioSEOSpider *must* have a...