Aqua Dream

Results 2 issues of Aqua Dream

账号某些帖子或楼层被百度限制,只有登录相应账号才能看到内容,因此会有带cookie爬取的需求。cookie形式类似: ``` timeShow= BAIDUID= TIEBA_USERTYPE= TIEBAUID= pgv_pvi= bdshare_firstime= BAIDU_WISE_UID= IS_NEW_USER= SEENKW= BDUSS= BDUSS_BFESS= BDORZ= STOKEN= Hm_lvt_xxx= wise_device= Hm_lpvt_xxx= st_data= st_key_id= st_sign= ``` 其中重要的估计就BDUSS或者STOKEN。但我把cookie所有内容直接复制到未登录的浏览器里,似乎还是没法看到内容(还是未登录状态)。 若有成功的朋友,望指教。

help wanted

May you do a little modification to avoid these two warnings? > [py.warnings] WARNING: /.../scrapy/core/downloader/webclient.py:4: DeprecationWarning: twisted.web.client.HTTPClientFactory was deprecated in Twisted 16.7.0: please use https://pypi.org/project/treq/ or twisted.web.client.Agent instead from twisted.web.client...

cleanup