emijrp

dumpgenerator.py on Windows and filesystem support

7

_From [[email protected]](https://code.google.com/u/117938126361994489739/) on November 11, 2013 16:37:18_ Found an issue because I'm running r866 on a Windows machine and because the "?" on http://mamedev.emulab.it/undumped/index.php?title=File:Jinglebell(global?).jpg Checking api.php... http://mamedev.emulab.it/undumped/api.php api.php is OK...

keeps attempting to download the same images

5

_From [[email protected]](https://code.google.com/u/117477055505802199074/) on December 23, 2013 18:49:20_ Every time i attempt to resume a download, it starts with "Retrieving images from 'Apple of Discord.png'" the file is already downloaded (as...

Large histories memory error

22

_From [[email protected]](https://code.google.com/u/109758257449746321618/) on April 16, 2011 23:35:03_ RationalWiki:SPOV 18 edits RationalWiki:Saloon Bar 1 edits RationalWiki:Saloon Bar/Drink counter/Archive 1 2 edits RationalWiki:Saloon bar 2000 edits RationalWiki:Saloon bar 3000 edits RationalWiki:Saloon bar...

_From [[email protected]](https://code.google.com/u/101255742639286016490/) on February 02, 2014 18:52:12_ Example: http://archive.org/details/wiki-wikipovrayorg links a bogus http://archive.org/content/POV-Wiki:Copyrights I wonder if such pages should also be downloaded; there's little gain in a link when they...

Automatically resume and slow down on timeouts

4

_From [[email protected]](https://code.google.com/u/101255742639286016490/) on November 05, 2013 20:35:07_ wiki-site.com has some nasty configuration for which it stops responding, or sends error 403, if you do too many requests. I've tried 60,...

Setting up a crawler to list all MediaWiki wikis in the web

26

_From [[email protected]](https://code.google.com/u/101255742639286016490/) on May 04, 2013 12:28:07_ To grow our wikiteam collection of wikis, I have to increase our list of wikis. To archive our first 4500 wikis, we've used...

Task force corrupt dumps (empty .desc and image files)

7

_From [[email protected]](https://code.google.com/u/109758257449746321618/) on August 14, 2012 21:08:36_ Found some errors in task force dumps: - http://archive.org/details/wiki-spottingworldcom_wiki (corrupt images, empty desc http://www.spottingworld.com/File:Wikiquote-logo.svg ) - http://archive.org/details/wiki-stargate_sg1_solutionscom_w (images looks good but desc are...

Use API (tracking)

9

_From [[email protected]](https://code.google.com/u/101255742639286016490/) on March 01, 2012 00:41:27_ Many bugs request API usage or could (probably) be fixed by using API. Using API for pages is already many many times more...

English Wikitravel fails to download images

3

_From [[email protected]](https://code.google.com/u/109758257449746321618/) on July 26, 2011 22:36:59_ Checking api.php... api.php is OK Checking index.php... index.php is OK Analysing http://wikitravel.org/wiki/en/api.php Loading config file... Resuming previous dump process... Title list was completed...

With --resume --images checks only titles list

1

_From [[email protected]](https://code.google.com/u/101255742639286016490/) on July 17, 2011 11:16:51_ For instance: http://p.defau.lt/?iVHLRqTBGUece81mSO8M9Q I can't remember the original command, which probably didn't include --images, but even with --resume if --images is specified and...