AIL-framework icon indicating copy to clipboard operation
AIL-framework copied to clipboard

Published 20 hours ago • verified publisher icon CIRCL

Empty crawler queue

Open vascobelgiantrain opened this issue 4 years ago • 1 comments

Hi all,

We have been using AIL framework for some time now. Is there a possibility to clear or delete the queue of the crawler? If not, this would be a great feature!

After a while, my queue ends up being very big. Sometimes filled with non-existing onion domains.

Thanks in advance!

vascobelgiantrain avatar Jan 05 '21 09:01 vascobelgiantrain

small python script to empty crawler queues: clearCrawlerQueue.zip

g3rtg3rt avatar Apr 02 '21 13:04 g3rtg3rt