chronos
chronos copied to clipboard
Extract pieces of info from a web page's Wayback Machine history
Chronos
Chronos (previously known as WaybackUnifier) extracts pieces of data from a web page's history. It can be used to create custom wordlists, search for secrets, find old endpoints, etc.
Installation
From binary
Download a prebuilt binary from the releases page and unzip it.
From source
Use go get
to download and install the latest version
go get -u github.com/mhmdiaa/chronos
Presets
Presets are predefined options (URL path, match regex, and extract regex) that can be used to organize and simplify different use cases. The preset definitions are stored in ~/.chronos
as JSON files
$ cat ~/.chronos/robots.json
{
"path": "/robots.txt",
"match": "Disallow",
"extract": "(?:\\s)(/.*)"
}
$ chronos -pr robots -t example.com
$ # equivalent to...
$ chronos -p /robots.txt -m Disallow -e "(?:\\s)(/.*)"
Example usage
Extract paths from robots.txt files and build a wordlist
$ chronos -t example.com -p /robots.txt -m Disallow -e "(?:\\s)(/.*)" -o robots_wordlist.txt
Save all versions of a web page locally and filter out a specifc status code
$ chronos -t http://example.com/this_is_403_now_but_has_it_always_been_like_this_question_mark -fs 403 -od output
Save URLs of all subdomains of example.com that were last seen in 2015
$ chronos -t *.example.com -u -to 2015
Run the S3 preset that extract AWS S3 URLs
$ chronos -pr s3 -t example.com
Options
Usage: chronos <preset (optional)> <params>
-c int
Number of concurrent threads (default 10)
-e string
Extract regex
-fm string
Filter Mime codes
-from string
Match results after a specific date (Format: yyyyMMddhhmmss)
-fs string
Filter status codes
-m string
Match regex
-mm string
Match Mime codes
-ms string
Match status codes (default "200")
-o string
Output file path (default "output.txt")
-od string
Directory path to store matched results' entire pages
-p string
Path to add to the URL
-preset string
Preset name
-t string
Target URL/domain (supports wildcards)
-to string
Match results before a specific date (Format: yyyyMMddhhmmss)
-u URLs only
Contributing
Find a bug? Got a feature request? Have an interesting preset in mind? Issues and pull requests are always welcome :)