DarkSpider
DarkSpider copied to clipboard
PROxZIMA
Anatomy and Visualization of the Network structure of the Dark web using multi-threaded crawler
## Description A database manager for the `Crawler` and the `Extractor` modules. Neo4j is the most suitable candidate of all as it's fast, scalable and is capable of storing huge...
**Is your feature request related to a problem? Please describe.** Extractor takes maximum file name length under consideration and creates sub-directories based on the url. `http://a.com/b.ext?x=&y=$%z2` -> `a.com/b.extxyz2_.html` (`a.com` folder...
**Is your feature request related to a problem? Please describe.** Incremental Crawler visits a specific site multiple times in a specific interval of time. The main focus of an incremental...
**Is your feature request related to a problem? Please describe.** The Ultimate aim of the project is to detect illicit websites. As of now the algorithm uses graph knowledge to...
Dark web isn't made of just `.onion` links. Dark web consist of various darknets such as tor, I2P and freenet. These darknets also holds considerable amount of data. As they...
The distribution of the distance between connected pairs with the percentage of connected pairs. 
TLD wise distribution of incoming links from dark web to the surface web. 
Lay down the actual finding from all the graphs and insights. Must be logged in a file for further study.