Lime

Results 35 comments of Lime

https://github.com/shiyanhui/dht/wiki

这个速度应该算是正常吧, 重复的太多了.

Did you run it in local network? This crawler can't run behind NAT now.

Is it the sample that you are running? - There are two kind of peers message in dht protocol, `get_peers` and `announce_peer`. `get_peers` messages are far more than `announce_peer`. Only...

OK, I'll figure it out.

没什么好办法 crawler本身已经尽可能伪装了 一定时间内 新数据肯定越采集越少

最近比较忙, 等有时间了会实现这块.

Just add `"ts": "js"` to `extension_equivalence` in your settings. It may looks like: ```js "extension_equivalence": { "blade.php": "html", "ts": "js" } ```