Number1Tao

``` punct = set(u''':!),.:;?]}¢'"、。〉》」』】〕〗〞︰︱︳﹐､﹒ ﹔﹕﹖﹗﹚﹜﹞！），．：；？｜｝︴︶︸︺︼︾﹀﹂﹄﹏､～￠ 々‖•·ˇˉ―--′’”([{£¥'"‵〈《「『【〔〖（［｛￡￥〝︵︷︹︻ ︽︿﹁﹃﹙﹛﹝（｛“‘-—_…''') ```

爬取网页数目足够时，没能及时停止爬虫

1

http://www.sharejs.com/codes/python/8808

``` if int(doc1[i])int(doc2[j]): write_block1.push(':'+doc2[j]+'#'+tf2[j]) j+=1 else: write_block1.push(':'+doc2[j]+'#'+str(int(tf1[i])+int(tf2[j]))) i+=1 j+=1 ```

猜测头条网采用 动态加载的方式，所以失败

查阅资料：http://stackoverflow.com/questions/21788939/how-to-use-pycharm-to-debug-scrapy-projects 但是不成功