distributed-wikipedia-mirror icon indicating copy to clipboard operation
distributed-wikipedia-mirror copied to clipboard

Add all the other wikipedia snapshots

Open momack2 opened this issue 6 years ago • 1 comments

Many countries have blocked Wikipedia over the years, and Wikipedia has also suffered from DDOS attacks causing service drops in various regions. We should broaden our current list of Wikipedia mirrors to include other languages. I propose doing the languages with the most users - as of now there are 13 languages with more than 1M users and 6 languages with more than 2.5M users.

Language Wiki Users Active Users Good Pages Total Pages On IPFS
English en 37103876 124823 5926367 48505470
  • [x]
Spanish es 5543043 15373 1543777 6782414
  • [ ]
French fr 3544188 16349 2138049 10319452
  • [ ]
German de 3271376 18550 2341066 6547819
  • [ ]
Chinese zh 2803562 8437 1073112 5907531
  • [ ]
Russian ru 2589568 10331 1567312 5987865
  • [ ]
Portuguese pt 2297005 5696 1013328 4890332
  • [ ]
Italian it 1867701 8066 1551915 6360102
  • [ ]
Arabic ar 1709753 4342 949434 5651012
  • [ ]
Japanese ja 1527805 14061 1167744 3460642
  • [ ]
Indonesian id 1087372 2786 502154 2604650
  • [ ]
Turkish tr 1042570 683 333283 1666749
  • [x]
Dutch nl 1018242 3866 1978041 4116417
  • [ ]

For each:

  • [ ] create new snapshot of https://.wikipedia.org/wiki/
  • [ ] ensure canonical link is correct
    • this is blocked on upstream snapshots or updating our scripts: https://github.com/ipfs/distributed-wikipedia-mirror/issues/48#issuecomment-527230858 + https://github.com/ipfs/distributed-wikipedia-mirror/issues/65
  • [ ] pin
  • [ ] create and update DNSLink at .wikipedia-on-ipfs.org

momack2 avatar Sep 10 '19 02:09 momack2

I think we should put the Indic Wikipedia on that list, due to the recent push to block the access...

https://twitter.com/smittal_ips/status/1237030193937575938?s=19

RubenKelevra avatar Mar 09 '20 19:03 RubenKelevra