ail-framework Is there a way use the crawlers but not to auto-crawl found .onion and disable monthly recrawl?

Is there a way use the crawlers but not to auto-crawl found .onion and disable monthly recrawl?

Open certrik opened this issue 2 years ago • 4 comments

Is there a way use the crawlers but not to auto-crawl found .onion and disable monthly recrawl?

Mar 09 '22 21:03 certrik

Hey @certrik ! You can disable the auto-discovery by setting activate_crawler to False. (You need to restart the Onion module)

Mar 15 '22 10:03 Terrtia

Hi @Terrtia , okay. Thank you. Crawling itself won't be disabled in this case? Because I still like to use the crawler.

Mar 15 '22 11:03 certrik

The manual crawling is enabled by default if AIL can reach the Splash manager

Mar 15 '22 11:03 Terrtia

@Terrtia THX. Does this also diasble the automatic recrawl once a month?

Mar 16 '22 11:03 certrik