rucio
allow wildcard * on a scope level
Description
Hey guys,
last year at the rucio workshop in Lancaster we talked about the possibility to allow wildcards on the scope level.
By doing so queries like:
rucio list-dids --filter 'type=file' '*:some_prefix*' would be possible.
At the moment a * at the scope level is not allowed.
Motivation
If I remember correctly you said at the workshop that this is not a good idea for CERN, due to your huge number of files and scopes, which could make those kind of queries very slow and/or computationally intensive.
Nevertheless, this would be really helpful for other communities. For example in our case at a research institute for solar physics, we create a scope for every observation campaign. Within an observation campaign there is are files from different instruments, which can be distinguished by filename.
So, if we want to get all the data from an instrument no matter in which campaign we could do something like:
rucio list-dids --filter 'type=file' '*:telescopeA*'
I am sure this would be useful for others as well.
Change
The idea in Lancaster during a brief discussion on this topic was to make this feature configurable. So the default stays the same - no wildcard searches on scopes, but if needed the wildcard search on scope level can be enabled in the configs.
I hope you consider this proposal. Thank you.
I think this would be a very nice extension, and should be a server side configuration option so users can't work around it :-)
Hi Alex, Yes this is a good idea, but needs to be made configurable as Mario said.
