GoogleScraper icon indicating copy to clipboard operation
GoogleScraper copied to clipboard

installation issues - stacktrace

Open clarkk opened this issue 9 years ago • 6 comments

Post edited.. Traceback in next post :)

Debian Jessie

Install

apt-get install python-dev python-virtualenv python-pip
virtualenv --python python3 env
source env/bin/activate
pip install GoogleScraper

clarkk avatar Feb 11 '16 10:02 clarkk

Ok..

Don't know what I did, but now I can run the command.. But get a stacktrace

(env)root@dyntest-athlon-3700-2gb ~ # python -V
Python 3.4.2
(env)root@dyntest-athlon-3700-2gb ~ # GoogleScraper -h
Traceback (most recent call last):
  File "/root/env/bin/GoogleScraper", line 5, in <module>
    from pkg_resources import load_entry_point
  File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 2876, in <module>
    working_set = WorkingSet._build_master()
  File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 449, in _build_master
    ws.require(__requires__)
  File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 745, in require
    needed = self.resolve(parse_requirements(requirements))
  File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 639, in resolve
    raise DistributionNotFound(req)
pkg_resources.DistributionNotFound: aiohttp

clarkk avatar Feb 11 '16 12:02 clarkk

Here is the complete step by step installation

Install Google Chrome

wget -c wget https://dl.google.com/linux/direct/google-chrome-stable_current_amd64.deb && dpkg -i google-chrome-stable_current_amd64.deb
apt-get -f install

Install Selenium

apt-get install python-dev python-pip
pip install selenium

GoogleScraper

apt-get install python-virtualenv
virtualenv --python python3 env
source env/bin/activate
pip install GoogleScraper

Run

source env/bin/activate
GoogleScraper -h
# python -V
Python 3.4.2

Error

# GoogleScraper -h
Traceback (most recent call last):
  File "/root/env/bin/GoogleScraper", line 5, in <module>
    from pkg_resources import load_entry_point
  File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 2876, in <module>
    working_set = WorkingSet._build_master()
  File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 449, in _build_master
    ws.require(__requires__)
  File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 745, in require
    needed = self.resolve(parse_requirements(requirements))
  File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 639, in resolve
    raise DistributionNotFound(req)
pkg_resources.DistributionNotFound: aiohttp

clarkk avatar Feb 11 '16 20:02 clarkk

Same here, can't install

http Collecting aiohttp Using cached aiohttp-0.21.2.tar.gz Complete output from command python setup.py egg_info: Traceback (most recent call last): File "<string>", line 1, in <module> File "/tmp/pip-build-KM5mst/aiohttp/setup.py", line 61, in <module> raise RuntimeError("aiohttp requires Python 3.4.1+") RuntimeError: aiohttp requires Python 3.4.1+

I have python 3.4.3+ and 3.5 installed

MikhailPavlov avatar Feb 26 '16 16:02 MikhailPavlov

Installed this with commands:

git clone git://github.com/NikolaiT/GoogleScraper/ sudo -H python3 setup.py install

MikhailPavlov avatar Feb 26 '16 16:02 MikhailPavlov

Maybe you can check your version of python first. sys.version_info

ycchuang avatar Mar 04 '16 00:03 ycchuang

Following the instructions from @clarkk, I had a lot of similar errors on Ubuntu 14.04 but installing these packages first worked.

sudo apt-get install python3.4-dev python-virtualenv build-essential python-dev python-pip libxml2-dev libxslt1-dev zlib1g-dev

I also installed the Python 3.5 PPA from here before I began. It seems to have worked!

Installing zlib1g-dev came from this Stackoverflow question and libxml2-dev + libxslt1-dev were from @NikolaiT via this issue.

3ruce avatar Apr 14 '16 12:04 3ruce