Desmond Cheong
Desmond Cheong
Resolved with https://github.com/Eventual-Inc/Daft/pull/2826
Probably wasn't intended. It seems the combination of options: ``` let file = fs::OpenOptions::new() .read(true) .create(true) .truncate(false) .open(&path)?; ``` is invalid and throws an error for me.
Why not just remove `.write` and `.truncate` since this is inside the reader?
Hi @mwc360, what are you trying to read - a parquet file, a deltalake table, something else? A stack trace may be useful here too. Could you also help check...
Ah to clarify, I wanted to check abfs specifically versus abfss. Iirc in the past we've seen one scheme working and not the other. We followed Azure's fsspec approach and...
Hey @mwc360 this issue is pretty stale. If you get a chance to try out abfs versus abfss do let us know! For now I'm going to unassign myself on...
``` ; daft provisioned up Error: TOML parse error at line 3, column 1 | 3 | [setup] | ^^^^^^^ The path, "/Users/jessieyoung/.ssh/desmond.pem", does not exist ``` 😅
Hi @caican00, could you share the output of the query plan, e.g. via ``` df = daft.read_parquet( "/mnt/test/processed_data/outputs/" ).where("id ='807d7439-af41-494a-ae95-96c716ab4fae'").limit(10) df.explain(True) ``` It also seems that you're using the ray...
This branch is a little borked. Keeping a record of it but reopening the PR at https://github.com/Eventual-Inc/Daft/pull/3055
@kevinzwang Got so busy with other things that I never got back to this. Just updated with your comments, lmk what you think!