Mitra Ardron comments

Results 372 comments of


                                            Mitra Ardron

Mediatype: texts - should use dweb instead of direct calls

Done: ./crawl.js --level all zandvoort.newspapers.1992.zandvoorts.nieuwsblad but it missed the big files (>700Mb for the zip)

Mediatype: texts - should use dweb instead of direct calls

(Note to self - see EN/Dweb - Archive - Text)

Mediatype: texts - should use dweb instead of direct calls

An example of a text item with multiple "books" try https://archive.org/details/ialerequestsummary Books are one page

Mediatype: texts - should use dweb instead of direct calls

EDITED: Background info: Multipage books thetaleofpeterra14838gut or alicesadventures19033gut are reasonably small but are displaying as a slide carousel [https://archive.org/search.php?query=mediatype:texts%20AND%20imagecount:8] shows small ones and unitednov65unit is an example

Mediatype: texts - should use dweb instead of direct calls

[ ] Figure out what switches slide carousel or bookreader

Mediatype: texts - should use dweb instead of direct calls

From Jeff Kaplan: typically if an item is `mediatype=texts` and there is an abby and pdf file then it will result in a bookreader presentation. loose images would not result...

Mediatype: texts - should use dweb instead of direct calls

See - #109 for failure case (Peter Rabbit) that should use slide carousel

scaling to indefinite and changing groups of files

Thanks for the thinking .. I'm hoping we can use this exercise as an example of how DAT might work with a *large* and changing site like the Archive. IMHO...

scaling to indefinite and changing groups of files

@pfrazee asked "Are you certain that sharding the dataset to one-dat-per-folder, and only updating folder-dats that have peers, is not enough for you to scale?” Sure - this can be...

scaling to indefinite and changing groups of files

@martinheidegger - there are two possible approaches here - one DAT for the whole of the IA, or one DAT per item with a root-level DAT as an inde, both...