distributed-wikipedia-mirror
distributed-wikipedia-mirror copied to clipboard
ipfs
Putting Wikipedia Snapshots on IPFS
When I go to the page, all I see is this: ``` ipfs resolve -r /ipns/en.wikipedia-on-ipfs.org/wiki/Control_character.html: no link named "Control_character.html" under bafybeihn2f7lhumh4grizksi2fl233cyszqadkn424ptjajfenykpsaiw4 ```
Samsung A51, 128 GB internal, 512 GB microSD card with exFAT, >400 GB free. VDSL 50/10. 802.11ax, ~50 cm between Modem and Mobile. External power supply. Downloading larger files is...
badger shows consistent issues in go-ipfs 0.8.0 with 300GB of wikipedia_en_all_maxi_2021-02 ### Issues - oom-killer stopped the process at 30%, then 60% - unable to open resulting repo with 32GB...
Many countries have [blocked Wikipedia](https://en.wikipedia.org/wiki/Censorship_of_Wikipedia) over the years, and Wikipedia has also suffered from DDOS attacks causing service drops in various regions. We should broaden our current list of Wikipedia...
The version from #77 creates a basic environment with all dependencies for dev and debugging, but is not useful for end-to-end automation like one described in #58 The complexity involved...
> See parent issues first: #42 / https://github.com/ipfs/distributed-wikipedia-mirror/issues/69 > **tldr** we are looking at low hanging fruits when it comes to deduplication during `ipfa add` of files from https://download.kiwix.org/zim/wikipedia/ ##...
> This is just a quick brain dump with initial idea, > if there are some gaps in the plan, things to consider or known unknowns, let me know in...
> This is a placeholder issue. > Will be updated with more details when we gain better understanding of what is needed here. In the long run, we want to...
Would be great to have a doc with instructions for adding a new language
we should outline the control plan (hand over to wikipedia itself, etc)