Recursive web path scanning - provide user with paths, let them select which ones to scan

[sethsec]

at first i was going to have this be automatic, but i think that is a bad idea. i think i need to give the user a list of all the directories found, and let them pick which ones to submit back to celery:

./celerystalk post_process dirs

[0] http:/10.10.10.10/test [1] http:/10.10.10.10/dev

what dir's would you like to submit: 0-1

submitted 28 jobs to the queue..