Kelson
Kelson
> * where do we publish these stats files from farm.zimit.kiwix.org? (Github artifacts is not OK for end-users from my PoV) I would put them in the drive > *...
It seems pretty important to umplement this ticket , for Wikimedia recipes (not all mwoffliner recipes) because only the mwoffliner workers have a privileged access to Wikimedia API (no quota).
See also #431
Its not OK.
Raising prio and put in project Zimit2.
@benoit74 @rgaudin What about proposing a JSON format where the necessary information should be defined by the scraper. This data would be then indgested by both the scraper and the...
> I don't get where you want to put this JSON file and what it will contain. * "Defined by the scraper", so in the scraper repository * "necessary information",...
> I however wonder if adding all scrapers as Zimfarm dependencies wouldn't make more sense. I have no strong opinion. My proposal has the advantage to be pretty light. And...
@audiodude Last time it worked, WPEN was scrapable in 16GB AND the memory consumption was related (if not proportional) to the number of articles. The current situation is the result...
@Jaifroid The recommended way of doing it is to rely on _sw ZIM tag. Zimit2 should not need anything special at reader level AFAIK. @benoit74 Wonder this not explicit in...