Antoine Pitrou
Antoine Pitrou
There were some timeouts in some CI jobs. I've restarted them just in case. If that still reproduces, should first rebase from master to catch up with any upstream fixes.
> Something I am wondering more in general (potentially for future JIRA/PRs), when working with custom metadata, would it be useful to also allow to inspect the custom metadata of...
@oraix Some binary packages are available for Windows, so it's unexpected that pip is trying to compile from source. Can you post the output of `pip install --prefer-binary pyarrow`?
I'm a bit surprised. How are you using PyArrow exactly? Are you trying to link to Parquet C++ APIs?
Oh, I see: `libarrow_python` links to `libparquet` for Parquet encryption support.
That said, I wonder why the transitive dependency isn't picked up automatically.
Hmm, I'm not sure that's the intended use for `get_libraries`. Basically, `get_libraries` allows you to [link your C++ or Cython code](https://arrow.apache.org/docs/python/integration/extending.html#example) to the Arrow Python libraries, but it doesn't list...
Yes, but the part where `get_libraries()` isn't enough is because you are also copying the DLL files instead of simply distributing the entire PyArrow package, right?
> A separate Jira issue will be made to address closing files in V2 ParquetDataset, which needs to be handled in the C++ layer. Has that issue been opened already?
@wjones127 The numbers seem a bit low to be honest, but perhaps that's just me. I haven't looked at the implementation. @lidavidm What do you think?