Eventual-Inc
Daft doesn't work with OneLake
Describe the bug
Using both ABFSS and mounted OneLake storage, both options return file not found errors. I'm using other engines to query the exact same paths so it's not a "does the file actually exist error". I can't get either 0.4.18 or 0.5.7 to work.
To Reproduce
No response
Expected behavior
No response
Component(s)
Other
Additional context
No response
Hi @mwc360, what are you trying to read - a parquet file, a deltalake table, something else? A stack trace may be useful here too.
Could you also help check if abfs works?
neither mount nor ABFS work. I’ll reply with a stack trace next week!
Miles Cole Principal Program Manager Fabric CAT | Spark @.@.>
[signatureImage]
From: Desmond Cheong @.> Sent: Thursday, July 3, 2025 4:13:43 PM To: Eventual-Inc/Daft @.> Cc: Miles Cole @.>; Mention @.> Subject: Re: [Eventual-Inc/Daft] Daft doesn't work with OneLake (Issue #4692)
[https://avatars.githubusercontent.com/u/9080227?s=20&v=4]desmondcheongzx left a comment (Eventual-Inc/Daft#4692)https://github.com/Eventual-Inc/Daft/issues/4692#issuecomment-3033823017
Hi @mwc360https://github.com/mwc360, what are you trying to read - a parquet file, a deltalake table, something else? A stack trace may be useful here too.
Could you also help check if abfs works?
— Reply to this email directly, view it on GitHubhttps://github.com/Eventual-Inc/Daft/issues/4692#issuecomment-3033823017, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AMOKQ6CZGB5UJHEMHM6DQND3GWTJPAVCNFSM6AAAAACAXCBOECVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMZTHAZDGMBRG4. You are receiving this because you were mentioned.Message ID: @.***>
Ah to clarify, I wanted to check abfs specifically versus abfss. Iirc in the past we've seen one scheme working and not the other. We followed Azure's fsspec approach and map one to the other but maybe we missed a case.
Hey @mwc360 this issue is pretty stale. If you get a chance to try out abfs versus abfss do let us know!
For now I'm going to unassign myself on this issue. If any contributor using OneLake wants to jump in, please do!