MythHack

sh: line 0: ulimit: open files: cannot modify limit: Invalid argument 应该是默认设置的太大了。我尝试了一下最大是10240

抓去用户信息时不能判断是否是企业帐号

2

在抓取信息的时候暂时还不能判断是否是企业帐号，如果是企业帐号的话信息就会为空了~应该是少了个if神马的  有时还会直接catch get 1908349515 url: http://weibo.com/1908349515/info Error when handle bundle: 1908349515, url: http://weibo.com/1908349515/info ValidationError (WeiboUser:54888bf6c95f801b60bce315) (site.Invalid URL: http://w eibo.com/376765750 http://weibo.com/linuxde: ['info']) Traceback (most recent call last): File "D:\cola\cola\job\executor.py", line...

dev抓取微博报错

2

抓取微博的时候不知道为什么 parsers的176行会报错 mblog.created = parse(div.select('a.S_link2.WB_time')[0]['title']) 以下是错误信息 D:\cola\contrib\weibo>init.py D:\cola\cola\core\opener.py:108: UserWarning: gzip transfer encoding is experimental! self.browser.set_handle_gzip(True) start to process priority: 0 process bundle from priority 0 get 3211200050 url: http://weibo.com/aj/mblog/mbloglist?count=15&pre_page=1&uid=3211200050&end_id=3786010796038435&_t=0&_k=1418233717575000&__rnd=1418233835289&pagebar=0&max_id=3751405376185938&page=1 D:\cola\cola\core\opener.py:108:...