JewelCrawler icon indicating copy to clipboard operation
JewelCrawler copied to clipboard

豆瓣电影爬虫——a crawler which is able to crawl movie detail and short comments, save them to database mysql, also include Sentiment analysis based on comments

Results 2 JewelCrawler issues
Sort by recently updated
recently updated
newest added

![image](https://user-images.githubusercontent.com/27632562/39592481-78300a12-4f39-11e8-8a34-66267e35ce0a.png) 一直重复这个,并且还不解析数据出来这是为啥

前辈您好,我运行您的项目时会出现一部电影爬取好几次,是不是没有去重呢?