animal-crossing-scraper
animal-crossing-scraper copied to clipboard
Published
20 hours ago •
sungyeonu
sungyeonu
Web scraper for Animal Crossing - New Horizons data using bs4
animal-crossing-scraper
Python webscraper to extract various data of the game Animal Crossing - New Horizons.
Data source: https://animalcrossing.fandom.com/wiki/
Feel free to use the JSON files! Some of the pages on the wiki are incomplete, so if some data is missing please check back later.
Output
All JSON files are stored in /data
-- Completed --
/museums
- bugs.json
- fish.json
- fossils.json
- artwork.json
/characters
- villagers.json
/flowers
- availability.json
- genetics_others.json
- genetics_rose.json
- hybridization_advanced.json
- hybridization_simple.json
/music
-- Incomplete --
/crafting
- tools.json
- equipments.json
- housewares.json
- miscellaneous.json
- wallMounteds.json
- wallpaperRugsFloorings.json
- others.json
/clothing
- tops.json
- bottoms.json
- dresses.json
- hats.json
- accessories.json
- socks.json
- shoes.json
- bags.json
- umbrellas.json
JSON fields
Price: -1 indicates the data is not available yet.
Set Up
- In the animal-crossing-scraper root directory, clone the project using
git clone https://github.com/sungyeonu/animal-crossing-scraper.git
- Set up a virtual environment
python -m venv venv
- Activate the virtual environment
- Windows:
venv\Scripts\activate - Linux/Mac:
source venv/bin/activate
- Install required packages
pip install -r requirements.txt
Usage
To run:
python scrapy.py
To test:
python test_scrapy.py
sungyeonu