adlfs icon indicating copy to clipboard operation
adlfs copied to clipboard

Using dfs endpoint

Open wielrenner opened this issue 4 years ago • 2 comments

For my ADLS2 blob I only have a dfs endpoint configured as a private endpoint.

When trying to list folder/files in a blob I get a HttpResponseError.

HttpResponseError: This request is not authorized to perform this operation. RequestId:00f7171a-201e-0039-6842-f5ecb8000000 Time:2021-01-28T06:54:33.4368226Z ErrorCode:AuthorizationFailure Error:None

Trying to set fs.account_url = "https://{}.dfs.core.windows.net".format(os.environ['AZURE_ACCOUNT_NAME']) also does not result in communication via the dfs endpoint. If I allow access from all networks on my storage account I'm able to connect.

I'm making the connection via a service principal. fs = AzureBlobFileSystem(account_name=xxxx, tenant_id=xxxx, client_id=xxxx, client_secret=xxxx)

wielrenner avatar Jan 28 '21 07:01 wielrenner

Any thoughts?

wielrenner avatar Feb 23 '21 08:02 wielrenner

@wielrenner How did you solve this or did you create a workaround?

sdebruyn avatar Jan 28 '22 10:01 sdebruyn