xA-Scraper
xA-Scraper copied to clipboard
Bumps [future](https://github.com/PythonCharmers/python-future) from 0.18.2 to 0.18.3. Release notes Sourced from future's releases. v0.18.3 This is a minor bug-fix release containing a number of fixes: Backport fix for bpo-38804 (c91d70b) Fix...
This fixes the page iteration on Patreon. The previous mechanism was (for whatever reason) skipping posts seemingly at random. This one: 1. Stores the request string in a variable. Note...
I am trying to get this to scrape patreon, but every time it runs the scheduled scrape, I get this error: ``` Main.Runtime - INFO - Scheduler executing class: ScraperBase...
`ugoira` (included in `requirements.txt` file in repo root) doesn't install due to requests `2.24.0` installing instead of the required `requests=2.25.1`. Full error: `ERROR: ugoira 0.8.0 has requirement requests=2.25.1, but you'll...
Adds the ability to configure a list of artists to exclude in scraping. useful if you support artists that exclusively distribute rewards in messages or you support other creators that...
I'm trying to run an FA scrape, after doing a git pull (and subsequently re-making my settings.py to get it working again), and getting this: ``` (venv) ✘ username@Monolith ...
I'm getting this problem using the old method, the one that doesn't involve a headless browser. It started up just a few hours ago. At first I thought it was...
(1) As we've talked about before, due to things like metadata in particular, two images can have the same exact image data, but be different in size - sometimes even...
Sometimes people change their twitter handle or delete their account. As if that wasn't bad enough, sometimes someone else starts using the same handle. Sometimes users even go back to...
Just now noticed, but only the initial pic in a 'series' post is captured, artists often will include extra pictures in the submission's "description". (Unfortunately these pictures are of lower...