databroker icon indicating copy to clipboard operation
databroker copied to clipboard

Support for Object Store

Open gwbischof opened this issue 5 years ago • 2 comments

It would be nice to be able to lookup files by a uid instead of a file path. This would mean that we wouldn't have to update the mongo documents (resource root + file_path) depending on where we are looking at the data from. It might be nice to have a file search path, which would be a place to search for files by their uid. Also I think object store support would be useful.

gwbischof avatar Oct 09 '20 17:10 gwbischof

Maybe just having a URI or something would be more flexible for the cases where we don't have or want a posix file path

stuartcampbell avatar Oct 09 '20 18:10 stuartcampbell

The resource_path, root, and path_semantics keys in the resource documents are all just strings, there is nothing preventing us from deciding to treat them as URIs rather than paths. This is how it is documented in the resource schema:

        "resource_path": {
            "type": "string",
            "description": "Filepath or URI for locating this resource"
        },

If we move to an object store model, we are still going to need to maintain both the root and resource_path analogs (e.g. "what bucket" and "what object in said bucket").

tacaswell avatar Oct 16 '20 16:10 tacaswell