GoogleScraper
GoogleScraper copied to clipboard
installation issues - stacktrace
Post edited.. Traceback in next post :)
Debian Jessie
Install
apt-get install python-dev python-virtualenv python-pip
virtualenv --python python3 env
source env/bin/activate
pip install GoogleScraper
Ok..
Don't know what I did, but now I can run the command.. But get a stacktrace
(env)root@dyntest-athlon-3700-2gb ~ # python -V
Python 3.4.2
(env)root@dyntest-athlon-3700-2gb ~ # GoogleScraper -h
Traceback (most recent call last):
File "/root/env/bin/GoogleScraper", line 5, in <module>
from pkg_resources import load_entry_point
File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 2876, in <module>
working_set = WorkingSet._build_master()
File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 449, in _build_master
ws.require(__requires__)
File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 745, in require
needed = self.resolve(parse_requirements(requirements))
File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 639, in resolve
raise DistributionNotFound(req)
pkg_resources.DistributionNotFound: aiohttp
Here is the complete step by step installation
Install Google Chrome
wget -c wget https://dl.google.com/linux/direct/google-chrome-stable_current_amd64.deb && dpkg -i google-chrome-stable_current_amd64.deb
apt-get -f install
Install Selenium
apt-get install python-dev python-pip
pip install selenium
GoogleScraper
apt-get install python-virtualenv
virtualenv --python python3 env
source env/bin/activate
pip install GoogleScraper
Run
source env/bin/activate
GoogleScraper -h
# python -V
Python 3.4.2
Error
# GoogleScraper -h
Traceback (most recent call last):
File "/root/env/bin/GoogleScraper", line 5, in <module>
from pkg_resources import load_entry_point
File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 2876, in <module>
working_set = WorkingSet._build_master()
File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 449, in _build_master
ws.require(__requires__)
File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 745, in require
needed = self.resolve(parse_requirements(requirements))
File "/root/env/lib/python3.4/site-packages/pkg_resources.py", line 639, in resolve
raise DistributionNotFound(req)
pkg_resources.DistributionNotFound: aiohttp
Same here, can't install
http Collecting aiohttp Using cached aiohttp-0.21.2.tar.gz Complete output from command python setup.py egg_info: Traceback (most recent call last): File "<string>", line 1, in <module> File "/tmp/pip-build-KM5mst/aiohttp/setup.py", line 61, in <module> raise RuntimeError("aiohttp requires Python 3.4.1+") RuntimeError: aiohttp requires Python 3.4.1+
I have python 3.4.3+ and 3.5 installed
Installed this with commands:
git clone git://github.com/NikolaiT/GoogleScraper/ sudo -H python3 setup.py install
Maybe you can check your version of python first. sys.version_info
Following the instructions from @clarkk, I had a lot of similar errors on Ubuntu 14.04 but installing these packages first worked.
sudo apt-get install python3.4-dev python-virtualenv build-essential python-dev python-pip libxml2-dev libxslt1-dev zlib1g-dev
I also installed the Python 3.5 PPA from here before I began. It seems to have worked!
Installing zlib1g-dev
came from this Stackoverflow question and libxml2-dev + libxslt1-dev
were from @NikolaiT via this issue.