filesystem_spec icon indicating copy to clipboard operation
filesystem_spec copied to clipboard

Published 20 hours ago • verified publisher icon fsspec

Add url spec to filesystem

Open jcampbell05 opened this issue 2 years ago • 2 comments

For some file providers it's handy to get a url for a specfici file. For example for S3 you may want a pre-signed url you can give to another server or client to allow them to write.

Some backend like S3 and GCP have implemented a url method to allow you to do this. But it's not part of the official spec.

jcampbell05 avatar Jun 30 '23 13:06 jcampbell05

The spec has the method sign() meant for this purpose, which is an alias for url() in s3 and gcs. I find sign more explicit for its intentions - it's not just a unique URL.

martindurant avatar Jun 30 '23 13:06 martindurant

Ah okay, didn't see that in the documentation initially. It doesn't appear to be in the user functions area, so I'm guessing it would be the file handler returned which has this method.

Same with any method involving metadata.

jcampbell05 avatar Jun 30 '23 17:06 jcampbell05