zim-requests icon indicating copy to clipboard operation
zim-requests copied to clipboard

Create recipe / Troubleshooting Art of Problem Solving

Open RavanJAltaie opened this issue 1 year ago • 7 comments

As per this https://github.com/openzim/zim-requests/issues/763, please check why this recipe is failing while we have already a successful resulted file in the past.

The link to the recipe on the Zimfarm: https://farm.openzim.org/recipes/art_of_problem_solving

The link to last working ZIM (if any): https://download.kiwix.org/zim/other/artofproblemsolving_en_all_maxi_2021-03.zim

The error I get: Unable to find appropriate API endpoint to retrieve article HTML

RavanJAltaie avatar Jan 04 '24 11:01 RavanJAltaie

Actually we have no recipe for this, we should first create one and see how MWoffliner behaves. Online wiki address is artofproblemsolving.com/wiki/. Moving to openzim/zim-requests for the moment as I strongly suspect it works fine now.

kelson42 avatar Jul 07 '25 11:07 kelson42

Recipe moved here: https://farm.openzim.org/recipes/art-of-problem-solving_en_all

benoit74 avatar Jul 07 '25 12:07 benoit74

The site became ultra slow, crawling might be an issue if the zim crawler's time out time is too short. Note for if the trials fail for that reason.

(I'm not apart of the zim team, just want a zim because the site is slow and the most recent version on internet archive is from may 2025)

inconspicuous-dev avatar Jul 21 '25 23:07 inconspicuous-dev

Indeed, we cannot scrape such a slow wiki, especially since it will probably only make the situation worse for most users.

benoit74 avatar Jul 22 '25 07:07 benoit74

The weird thing is after I tried independently scraping the wiki to create a zim, it became a bit faster.

(Probably due to site cache) Site doesn't get slower after crawling, usually it stays the same. Although the load times are still abysmally slow and the webcrawler will most likely time out.

inconspicuous-dev avatar Jul 22 '25 07:07 inconspicuous-dev

So what's our next step here? Close as WONTFIX?

Popolechien avatar Jul 27 '25 14:07 Popolechien

Site is not slow anymore, we should give it a new try (recipe is at https://farm.openzim.org/recipes/art-of-problem-solving_en_all now)

benoit74 avatar Aug 18 '25 08:08 benoit74