pyfilesystem2 icon indicating copy to clipboard operation
pyfilesystem2 copied to clipboard

Azure storage account support?

Open ericksc opened this issue 3 years ago • 6 comments

I am wondering if there is support for Azure storage account for blob. Is it possible?

ericksc avatar Mar 22 '21 18:03 ericksc

Does #372 help? See also https://www.pyfilesystem.org/page/index-of-filesystems/

lurch avatar Mar 22 '21 21:03 lurch

thank you, is azurefs also compatible with Azure blob storage account?

ericksc avatar Mar 22 '21 21:03 ericksc

I've got no idea (I've never used it myself) - that's something you'll have to ask the azurefs author.

lurch avatar Mar 22 '21 21:03 lurch

Both glenfant/fs.datalake and our emedgene/fs_dlk implementation don't support Azure blob storage.

I would suggested to copy one of the existing implementation and change the underline client to the blob sdk client. Can be a fairly simple project. Internally we implemented more than 5 different filesystems usually takes a few days. You can DM me for any question or help.

nivm avatar Apr 05 '21 08:04 nivm

we are working on blobfs - will post soon

amit-ezra avatar Aug 02 '21 13:08 amit-ezra

In case this is useful, we have this fs-azureblob implementation for blob storage, only caveat being the way directories are "faked" (note on this in the readme). ~~There is support for gen2 data lake as well pending PR review/release.~~ edit: accounts with hierarchical namespaces (gen2 data lake) are also supported.

jenhagg avatar Jul 05 '22 18:07 jenhagg