Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision |
| mirroring_wikipedia [2024/05/19 10:39] – simon | mirroring_wikipedia [2024/05/19 10:41] (current) – [Serving the snapshot] simon |
|---|
| ====== Mirroring Wikipedia ====== | ====== Mirroring Wikipedia ====== |
| |
| ===== Getting a snapshot ===== | |
| |
| The simplest way to mirror Wikipedia is using the [[https://kiwix.org/|Kiwix tools]] and a [[https://en.wikipedia.org/wiki/ZIM_(file_format)|Zim]] format snapshot. | The simplest way to mirror Wikipedia is using the [[https://kiwix.org/|Kiwix tools]] and a [[https://en.wikipedia.org/wiki/ZIM_(file_format)|Zim]] format snapshot. |
| | |
| | ===== Getting a snapshot ===== |
| |
| Downloading one of these snapshots is fairly simple - the Kiwix site [[https://download.kiwix.org/zim/wikipedia/|maintains pages with links]] to ''zim'' files for various facets of Wikipedia. They're broken down by language (''en'', in the filename), topic-specific (eg [[https://download.kiwix.org/zim/wikipedia/wikipedia_en_chemistry_mini_2024-04.zim|Chemistry]]) and other variations (options like mini, maxi, nopic allow us to further control how much data we're willing download.) | Downloading one of these snapshots is fairly simple - the Kiwix site [[https://download.kiwix.org/zim/wikipedia/|maintains pages with links]] to ''zim'' files for various facets of Wikipedia. They're broken down by language (''en'', in the filename), topic-specific (eg [[https://download.kiwix.org/zim/wikipedia/wikipedia_en_chemistry_mini_2024-04.zim|Chemistry]]) and other variations (options like mini, maxi, nopic allow us to further control how much data we're willing download.) |
| ''sudo apt-get install kiwix-tools'' | ''sudo apt-get install kiwix-tools'' |
| |
| ...and then run it with our snapshot like this: | ...and then run the serving app with our snapshot like this: |
| |
| ''kiwix-serve -p 8080 wikipedia_en_chemistry_mini_2024-04.zim'' | ''kiwix-serve -p 8080 wikipedia_en_chemistry_mini_2024-04.zim'' |
