CeWL icon indicating copy to clipboard operation
CeWL copied to clipboard

--exclude not working

Open Pusher91 opened this issue 2 years ago • 1 comments

I am running this command: cewl http://faculty.htb/admin/ -H 'Cookie: PHPSESSID=i8srqte0pgvltdlnffi69769t6' -d 6 --exclude cewl.exclude --debug

cewl.exclude contains a single line: ajax.php?action=logout

When I run the cewl command with --debug it detects the following links links = ["#", "ajax.php?action=logout", "index.php?page=home", "index.php?page=courses", "index.php?page=subjects", "index.php?page=faculty", "index.php?page=schedule", "#"]

However, I also find in the debug output that is still checks the url that I have listed in my exclude file: Checking page http://faculty.htb:80/admin/ajax.php?action=logout

After it checks the logout url (/ajax.php?action=logout), I lose my cookie and the script dies shortly after.

Am I doing something wrong? I have tried including other urls in my exclude file as well, such as:

  • http://faculty.htb/admin/ajax.php?action=logout
  • faculty.htb/admin/ajax.php?action=logout
  • /admin/ajax.php?action=logout
  • /ajax.php?action=logout

It still hits the logout url and kills my cookie, which ends the word scraping.

Pusher91 avatar Jul 09 '22 03:07 Pusher91

It was only checking the page name, not the parameters, I've just pushed an update, see if that fixes it.

https://github.com/digininja/CeWL/commit/ff7e4854da355f116448219ad8d0e9fe68592caa

digininja avatar Jul 11 '22 12:07 digininja

Assuming this fixed it.

digininja avatar Sep 06 '22 10:09 digininja