major-scrapy-spiders

major-scrapy-spiders copied to clipboard

A question about page turning

1

Hi， How to get more package names on the search page, for example:https://play.google.com/store/search?q=clean&c=apps

yangcloud

I've installed all the requirement packages. but when I run "scrapy crawl GooglePlayStore", It says 2017-11-17 10:53:11 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://play.google.com/store/apps/collection/promotion_3001b85_impossible_games?clp=SjcKKAoicHJvbW90aW9uXzMwMDFiODVfaW1wb3NzaWJsZV9nYW1lcxAHGAMSC0dBTUVfQVJDQURF:S:ANO1ljJlLEA) Traceback (most recent call last): File...

zxr445116086

(scrapy-splash) user@user-desktop:~/mss$ scrapy crawl facebook 2022-10-11 08:39:55 [scrapy.utils.log] INFO: Scrapy 1.4.0 started (bot: mss) 2022-10-11 08:39:55 [scrapy.utils.log] INFO: Overridden settings: {'BOT_NAME': 'mss', 'NEWSPIDER_MODULE': 'mss.spiders', 'SPIDER_MODULES': ['mss.spiders'], 'USER_AGENT': 'Mozilla/5.0 (X11; Ubuntu;...

santosadrian