NewsSpider

NewsSpider copied to clipboard

Bumps [scrapy](https://github.com/scrapy/scrapy) from 1.7.3 to 2.6.2. Release notes Sourced from scrapy's releases. 2.6.2 Fixes a security issue around HTTP proxy usage, and addresses a few regressions introduced in Scrapy 2.6.0....

dependabot[bot]

还用python2，什么年代了？？？？

5

SeekPoint

passerbyo

每次运行的时候都报错

1

` spider_loader = self.crawler_process.spider_loader ^ TabError: inconsistent use of tabs and spaces in indentation`

ymmagic

Which version of scrapy to use for this project?

2

I keep getting `import errors`, so I wonder if anyone could tell us which version of scrapy to use. So far, the `import errors` including: - `from scrapy import log`...

00001101-xt

问一下你是怎么爬取到的？它不是有个html标签隐藏了吗？

nuobingyu

爬取今日头条

1

你好，我在运行./start.sh时出现如下问题 File "/home/i-chenting/NewsSpider-master/news_spider/news_spider/spiders/TouTiaoSpider.py", line 41, in parseNews title = articles.xpath("//div[@class='article-header']/h1/text()").extract()[0] IndexError: list index out of range 请问是什么原因

chenting0324

爬取主流新闻网站数据

2

有一个想法，爬取主流网站的数据。 然后显示这些网站是如何引导人们的注意力，然后塑造认知的。 并不以爬取内容展示，用可视化的方法展现。 比如知乎首页推荐内容，如果用户授权，就可以知道知乎给自己推荐的是什么内容了。

autoool

Bumps [scrapy](https://github.com/scrapy/scrapy) from 1.7.3 to 2.11.1. Release notes Sourced from scrapy's releases. 2.11.1 Security bug fixes. Support for Twisted >= 23.8.0. Documentation improvements. See the full changelog. 2.11.0 Spiders can...

dependabot[bot]

Bumps [scrapy](https://github.com/scrapy/scrapy) from 1.7.3 to 2.11.2. Release notes Sourced from scrapy's releases. 2.11.2 Mostly bug fixes, including security bug fixes. See the full changelog. 2.11.1 Security bug fixes. Support for...

dependabot[bot]