Kemono-scraper icon indicating copy to clipboard operation
Kemono-scraper copied to clipboard

added --page flag to limit the number of pages fetched on kemono

Open dahunni opened this issue 5 months ago • 0 comments

Fix: Prevent Endless Fetching and Add Page Limit Flag

Problem

The existing code had two issues:

  1. The program would endlessly fetch the creator list due to an unintended loop.
  2. The requests were made too quickly, causing timeouts and overloading the server.

Solution

  • Page Limit Flag: Added a --pages flag to limit the number of pages fetched, preventing infinite loops.
  • Delay Between Requests: Introduced a short delay between requests to avoid timeouts and comply with server rate limits.

dahunni avatar Sep 14 '24 16:09 dahunni