gospider
gospider copied to clipboard
Several bugs and enhancements
Hello there,
In the latest version, there are several bugs from which one of the most annoying ones is that -q
flag is not quite working as intended. here is an example output:
[aws-s3] - github-cloud.s3.amazonaws.com
[url] - [code-200] - https://github.githubassets.com/assets/gist-5b974504.js
[url] - [code-200] - https://github.githubassets.com/assets/behaviors-3afe1224.js
Another issue I'm getting is that the JSON output results in an error combined with jq
.
$ gospider -s https://github.com -q --json | jq
...
parse error: Invalid numeric literal at line 291, column 5
Another suggestion is that to provide a scheme-less URL support:
$ gospider -s github.com
above command doesn't work now, and only by using HTTP scheme it works:
$ gospider -s https://github.com
Regards, HolyBugx
The fix is quite simple (I might make a PR later on), in order to be compatible with jq or other json lines parsing tools, we need to write all non-JSON output to stderr:
fmt.Fprintf(os.Stderr, bannerPart1)