fakerwiki
fakerwiki copied to clipboard
FakerWiki is a library for local testing of Python ScraperWiki scripts.
h1. FakerWiki
Fakerwiki is a library for local testing of Python "ScraperWiki":http://scraperwiki.com/ scripts. Mostly it's just a copy of the ScraperWiki library with the database bits removed.
h2. Usage
cd fakerwiki mkvirtualenv --no-site-packages fakerwiki pip install -r requirements.txt python setup.py install python your_script_name.py
You can also use 'pip install fakerwiki', but this obviously won't build out your virtualenv with the standard scraperwiki packages from the requirements.txt in the repository.
h2. What works?
scraperwiki.scrape() scraperwiki.datastore.save()
h2. What could be added easily?
scraperwiki.datastore.retrieve() scraperwiki.datastore.fetch() scraperwiki.metadata.save() scraperwiki.metadata.get() geocoding with dummy data local caching of scraped pages
h2. License
GPLv3 ("same as ScraperWiki":https://kforgehosting.com/scraperwiki/trac/browser/LICENSE.txt)