Niko

lastly - this is not just a writer but also a reader problem, I get the same error if I do `DeltaTable("abfss://@onelake.dfs.fabric.microsoft.com//Tables/test", storage_options={"bearer_token": aadToken, "use_fabric_endpoint": "true"})`

hmm, strange, I had to lower the pyarrow version to avoid that other error I was getting. Actually, just re-installing v12.0.0 also works - maybe it comes with some incomplete...

I think I got to the bottom of this. Issue is likely related to the way ADLS access is configured in Azure Fabric - though `onelake.blob.fabric.microsoft.com` resolves to a public...

A shorter version of the answer - `curl` in Fabric runtime 1.1 seems to be using a different CA file (`/etc/ssl/certs/ca-certificates.crt`) than on 1.2 CA file (`/etc/pki/tls/certs/ca-bundle.trust.crt`), which also has...

and lastly, here is a ***really ugly*** solution if you are still keen on trying runtime 1.2. 1. Run `!openssl s_client -connect onelake.blob.fabric.microsoft.com:443` to get the certificate. 2. Copy the...

I wanted to re-create this issueon my side but so far I am unable. I tried matching @stefnba setup as close as I could (on Mac M2, python 3.10.7, generated...

Running it now on Azure Databricks notebook - still the same @ion-elgreco - started a loop with pyarrow v8 (deltalake is latest though, 0.13). A bit faster than on my...

Yes, it is VNET-injected workspace. Also, looks like @stefnba is having similar problem running from his local machine so the issue may not be unique to Azure -> Azure

I'm running this (on Databricks, my source parquet files are in DBFS root) ``` %pip install deltalake ``` ``` import os import datetime as dt import pyarrow.dataset as ds from...

Is this on Databricks? I get ``` /local_disk0/.ephemeral_nfs/envs/pythonEnv-2e004da5-e00b-47ff-b78a-3bcba4398610/lib/python3.10/site-packages/azureml/opendatasets/dataaccess/_blob_accessor.py:519: Warning: Please install azureml-dataset-runtimeusing pip install azureml-dataset-runtime warnings.warn( NotImplementedError: Linux distribution ubuntu 22.04 does not have automatic support. Missing packages: {'liblttng-ust.so.0'} .NET...