zim-requests wikipedia_en_all

Recipe: https://farm.openzim.org/recipes/wikipedia_en_all_maxi

[error] [2024-03-16T12:45:16.673Z] Error downloading article Katie_Rogers_(journalist)
[error] [2024-03-16T13:04:08.405Z] Error downloading article Partha_Pratim_Bora
[error] [2024-03-16T13:53:58.475Z] Unable to retrieve js/css dependencies for article 'Sadist (band)': internal_api_error_Wikimedia\RequestTimeout\RequestTimeoutException
[error] [2024-03-16T13:53:58.475Z] Error downloading article Sadist_(band)
[error] [2024-03-16T13:53:58.475Z] Failed to run mwoffliner after [157963s]: {
	"name": "Error",
	"message": "Unable to retrieve js/css dependencies for article 'Sadist (band)': internal_api_error_Wikimedia\\RequestTimeout\\RequestTimeoutException"
}
[error] [2024-03-16T13:53:58.475Z] 

**********

Unable to retrieve js/css dependencies for article 'Sadist (band)': internal_api_error_Wikimedia\RequestTimeout\RequestTimeoutException

**********

Upstream issue: https://github.com/openzim/mwoffliner/issues/2000

I disabled the recipe for now

Mar 18 '24 14:03 benoit74

Duplicate of #1270

Feb 27 '25 04:02 kelson42

It's the other way around, it #1270 the duplicate and it has been closed, so let's reopen this one

Feb 27 '25 07:02 benoit74

Issue solved with move to ActionParse, but there is a new one linked to the move to libzim 9 : https://github.com/openzim/mwoffliner/issues/2333

Jul 06 '25 11:07 benoit74

Seems like the last scrapping started on July 25, 2025 is stuck. Last log was on 2025-08-01, more then 10 days ago and it was like "Not able to download content for ...". And in stderr at the same time: [error] [2025-08-01T10:28:22.245Z] Error (InternalError: We encountered an internal error. Please retry the operation again later.) while downloading the object .... Both URLs are somewhere at upload.wikimedia.org. I think, troubleshooting or restart is necessary.

Aug 12 '25 13:08 dm1sh

Not speaking about the fact it was started with 1.16.0 which is known to have issues with maxi of WPEN ... just restarted with dev version

Aug 18 '25 08:08 benoit74

Finally successful! https://browse.library.kiwix.org/viewer#wikipedia_en_all_maxi_2025-08/

Aug 24 '25 19:08 kelson42

Finally successful! https://browse.library.kiwix.org/viewer#wikipedia_en_all_maxi_2025-08/

@kelson42 @benoit74 Looks like the link used in the library is broken and doesn't redirect to the custom main page for some reason: https://browse.library.kiwix.org/viewer#wikipedia_en_all_maxi_2025-08

Other 2025-08 mwoffliner ZIMs seem to be fine, even when using custom main pages. Adding a / like in your link above does result in the correct redirect.

Aug 24 '25 23:08 Markus-Rost

@rgaudin Something on the library creation side?

Aug 25 '25 04:08 kelson42

Nope, it's "only" a cache issue, see https://github.com/kiwix/operations/issues/459 ; works well with the trailing / now that I've purged the cache for this ZIM, waiting to fix properly the "no-slash", not sure why purge did not worked for this (or more exactly, why we do not purge this as well)

Nothing wrong on ZIM generation side, library generation side, we have issue in proper repo, so let's close this issue again, nothing left here.

Aug 25 '25 06:08 benoit74

wikipedia_en_all_maxi has failed