vikstrous
Support for other trackers
Since we've had issues with TPB going down many times, we should make pirate-get a bit more modular and add support for more trackers. Here's the list of popular trackers that we should support:
http://torrentfreak.com/top-popular-torrent-sites-2015-150104/
While we are at it, we should make sure that we take advantage of trackers that support downloading torrents files directly instead of using the torrent caching service for all trackers.
I'm be curious to see this added. Any thoughts on how to make that happen? Perhaps a framework to add sites?
Every website would require an ad-hoc parser or an API. It would be a lot of work to do and a major rewrite of pirate-get. I think a better approach is to write a simple search engine for the bittorrent DHT. This way it will be really raid-proof.
Yes, something like that. The problem is I have no idea how these crawlers work.
I figured out the details at one point. I don't remember exactly how it works any more, but it basically runs multiple peers on the DHT and for every search someone makes, it records the hash of the torrent. Then it makes the same search itself, downloads to torrent file and indexes it.