Niko
Niko
yes, I managed to get the same error with maturin==0.13.6. It also give a warning during the build `⚠️ Warning: Couldn't find the symbol `PyInit_deltalake` in the native library. Python...
This is coming from `object_store` in Apache Arrow, maybe need to raise an issue there: https://github.com/apache/arrow-rs/blob/91acfb07a9929a2d6721c5417e47c0c472372a86/object_store/src/path/parts.rs#L91C15
As far as I know the flow is Deltalake->Arrow->DuckDB, if they need stats in DuckDB does it mean they are not pushing down any query to Deltalake? I don't know...
There are 3 writes to the table in that test, could all 3 be within the same millisecond? The test is picking up v1 timestamp then retrieving a version for...
Interesting results after some extra tracing within this test All the history timestamps are [1703869558237, 1703869559278, 1703869560403, 1703869561411] showing that they are in sequence with 1 sec gap between them...
Problem located - this is not a flaky team IMO but a bug. It starts here with creating a new DeltaTable with no history/timestamps loaded: https://github.com/delta-io/delta-rs/blob/02e26e5ecd7a8a64609bd21e8cb30e9bad4cc17b/crates/deltalake-core/src/operations/restore.rs#L142C44-L142C44 The consequences surface here:...
@bcdobbs is there any chance that in the environment where the notebook is running, traffic goes through some appliance with SSL inspection (I don't know much about Fabric notebooks)? https://onelake.blob.fabric.microsoft.com/...
btw, an easy way to answer my question would be running something like this in the notebook. ``` import requests requests.get('https://onelake.blob.fabric.microsoft.com/').content ``` If you get `Healthy` then my earlier theory...
OK @bcdobbs, ignore everything I wrote before 😁 , this looks like a problem with the writer because Spark writer works and so does the direct API call (i.e. I...
as for the other error I had - I installed `deltalake` with pip but then figured it doesn't work with the pyarrow in the cluster. Can you please check which...