AIL-framework icon indicating copy to clipboard operation
AIL-framework copied to clipboard

Automatic Crawler | Crawler.py KeyError: 'time'

Open 0vert1m3 opened this issue 5 years ago • 0 comments

Im using the newest AIL version available on Ubuntu 18.04, if I'm adding a v3 onion domain to the auto crawler with default settings it shows null on the Crawler Dashboard also its stuck on waiting.

Screen output:

------------------START CRAWLER------------------
crawler type:     onion
-------------------------------------------------
url:         http://xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx.onion
domain:      xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx.onion
domain_url:  http://xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx.onion

Traceback (most recent call last):
  File "./Crawler.py", line 413, in <module>
    crawler_config = load_crawler_config(to_crawl['type_service'], url_data['domain'], to_crawl['paste'],  to_crawl['url'], date)
  File "./Crawler.py", line 189, in load_crawler_config
    crawler_config['crawler_options'] = get_crawler_config(redis_crawler, 'auto', service_type, domain, url=url)
  File "./Crawler.py", line 173, in get_crawler_config
    crawler_options['time'] = int(config['time'])
KeyError: 'time'

0vert1m3 avatar Jun 07 '20 16:06 0vert1m3