dedomeno icon indicating copy to clipboard operation
dedomeno copied to clipboard

run dedomeno.

Open cgranadosk opened this issue 4 years ago • 0 comments

  • dedomeno version:
  • Python version:
  • Operating System:

Description

Describe what you were trying to get done. Tell us what happened, what went wrong, and what you expected to happen. I have cloned dedomeno. I only want to execute without django, I have defined all env variables and now all it's correct.

but when I run from terminal /opt/anaconda3/bin/scrapy crawl idealista -o test.csv -t csv

I received then next error:

/opt/anaconda3/lib/python3.8/site-packages/scrapy/utils/project.py:90: ScrapyDeprecationWarning: Use of environment variables prefixed with SCRAPY_ to override settings is deprecated. The following environment variables are currently defined: GMAIL_PASSWORD, GMAIL_USER, RECIPIENT warnings.warn( /opt/anaconda3/lib/python3.8/site-packages/scrapy/commands/init.py:129: ScrapyDeprecationWarning: The -t command line option is deprecated in favor of specifying the output format within the -o option, please check the -o option docs for more details feeds = feed_process_params_from_cli(self.settings, opts.output, opts.output_format) 2020-08-06 15:28:58 [scrapy.utils.log] INFO: Scrapy 2.2.1 started (bot: idealista) 2020-08-06 15:28:58 [scrapy.utils.log] INFO: Versions: lxml 4.5.2.0, libxml2 2.9.10, cssselect 1.1.0, parsel 1.6.0, w3lib 1.22.0, Twisted 20.3.0, Python 3.8.3 (default, Jul 2 2020, 11:26:31) - [Clang 10.0.0 ], pyOpenSSL 19.1.0 (OpenSSL 1.1.1g 21 Apr 2020), cryptography 2.9.2, Platform macOS-10.15.4-x86_64-i386-64bit Traceback (most recent call last): File "/opt/anaconda3/lib/python3.8/site-packages/scrapy/spiderloader.py", line 76, in load return self._spiders[spider_name] KeyError: 'idealista'

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/opt/anaconda3/bin/scrapy", line 8, in sys.exit(execute()) File "/opt/anaconda3/lib/python3.8/site-packages/scrapy/cmdline.py", line 143, in execute _run_print_help(parser, _run_command, cmd, args, opts) File "/opt/anaconda3/lib/python3.8/site-packages/scrapy/cmdline.py", line 98, in _run_print_help func(*a, **kw) File "/opt/anaconda3/lib/python3.8/site-packages/scrapy/cmdline.py", line 151, in _run_command cmd.run(args, opts) File "/opt/anaconda3/lib/python3.8/site-packages/scrapy/commands/crawl.py", line 22, in run crawl_defer = self.crawler_process.crawl(spname, **opts.spargs) File "/opt/anaconda3/lib/python3.8/site-packages/scrapy/crawler.py", line 191, in crawl crawler = self.create_crawler(crawler_or_spidercls) File "/opt/anaconda3/lib/python3.8/site-packages/scrapy/crawler.py", line 224, in create_crawler return self._create_crawler(crawler_or_spidercls) File "/opt/anaconda3/lib/python3.8/site-packages/scrapy/crawler.py", line 228, in _create_crawler spidercls = self.spider_loader.load(spidercls) File "/opt/anaconda3/lib/python3.8/site-packages/scrapy/spiderloader.py", line 78, in load raise KeyError("Spider not found: {}".format(spider_name)) KeyError: 'Spider not found: idealista'

I've tried in other folder and run with demono, but the error is the same

What I Did

Paste the command(s) you ran and the output.
If there was a crash, please include the traceback here.

cgranadosk avatar Aug 06 '20 13:08 cgranadosk