mik
mik copied to clipboard
MarcusBarnes
OAI toolchain: Use multiple set_spec options
Goal: run multiple OAI requests from one config file, once for each set_spec. The output of each request would go into a separate subdirectory below output_directory, each named for the set.
Related is an option to run without specifying sets individually, but still split the output into directories based on set.
From what I can tell, the OAI-PMH spec only allows for a single setSpec per request (more here). I'd have to think about how to implement allowing multiple setSpec values in MIK's configuration. If we allowed multiple values, we'd need to perform all of the harvesting from within a loop.
That sounds about right. You'd want to send an OAI request once per set; otherwise, even if OAI allowed multiple sets in a request, you'd get them all in one list. Looping makes sense.