ail-framework
ail-framework copied to clipboard
Is there a way use the crawlers but not to auto-crawl found .onion and disable monthly recrawl?
Is there a way use the crawlers but not to auto-crawl found .onion and disable monthly recrawl?
Hey @certrik ! You can disable the auto-discovery by setting activate_crawler to False. (You need to restart the Onion module)
Hi @Terrtia , okay. Thank you. Crawling itself won't be disabled in this case? Because I still like to use the crawler.
The manual crawling is enabled by default if AIL can reach the Splash manager
@Terrtia THX. Does this also diasble the automatic recrawl once a month?