amazon-scrapy

amazon-scrapy copied to clipboard

Bumps [scrapy](https://github.com/scrapy/scrapy) from 1.4.0 to 2.6.2. Release notes Sourced from scrapy's releases. 2.6.2 Fixes a security issue around HTTP proxy usage, and addresses a few regressions introduced in Scrapy 2.6.0....

dependabot[bot]

yiyuebitian

https://github.com/dynamohuang/amazon-scrapy/blob/master/amazon/amazon/middlewares/ProxyMiddleware.py 访问https的网站用http+ip_port 怎么会生效

625781186

关于特定关键词抓取对应ASIN的排名

5

您好。 我是电商小白，最近在弄爬亚马逊网页的关键词对应ASIN的排名。 在第一步我就卡住了，找不到亚马逊network里面的cookie，只有一个user-agent和一些accept数据。 请问您是通过cookie爬，还是通过其他一些途径？望您有空的时候，可以指点小弟一二。

huochequan

Hi, I would like to use this repo to get some info on amazon products. I'm not very familiar with scrapy (yet), and here's what I did : -Git clone...

ludovicschwartz

hello there, there is missing information about how exactly is the search key words work, there are a lot of tables but no data to put in the tables, because...

houhashv

User timeout caused connection failure.

1

Don't know if it is because of the Amazon has detected our bot and block the IP? But https://www.amazon.com/best-sellers-video-games/zgbs/videogames/?aja x=1&pg=3 Indeed doesn't existed, there is no page 3 there ....

Jorigorn

When the amazon review spider available?

1

Hi, thanks for open source the project. When the amazon review spider available? I would like to get some data about amazon product review. Thanks. John

Jorigorn

我使用的是scrapy 1.5,有部分错误，主要是utf8编码及其它问题，现在已能正常运行，但仍有几个问题请教： 1、product无保存item的代码及sql，我计划自行编写，不知后期会更新还是由使用者根据需要完善？ 2、asin、cate、detail 3个爬虫可独立运行，keyword和review等如何执行？独立运行提示参数不足？

hunkguo

Help in running the code

4

Hi @dynamohuang I am new to python scrapy and mysql anyway. I have finished creating the working environment for running your code (i.e. MySQL backend and run your code under...

kcyu1993