arrow
arrow copied to clipboard
apache
Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
Hi there, I have a large on-disk dataset that I am creating as follows (where `pa_path` is a `str` and `pa_fs` is of type `S3FileSystem`): ```py dataset = ds.dataset( source=pa_path,...
### Describe the enhancement requested # Packaging checklist for CRAN release For a high-level overview of the release process see the [Apache Arrow Release Management Guide](https://arrow.apache.org/docs/developers/release.html#post-release-tasks). cc @jonkeane @thisisnic @amoeba...
### Rationale for this change It'd be convenient to construct placeholder error Status cheaply. ### What changes are included in this PR? Added `bool Status::State::is_static` which causes copies to be...
### Rationale for this change For background please see #44393. When implementing the "scatter" function requested in #44393, I found it also useful to make it a public vector API....
### Rationale for this change In the current implementation, `arrow::Result::status()` always returns the internal `status_` field by a const lvalue reference, regardless of the value category of `Result`. This can...
### Rationale for this change Implement a convenience method to create boolean masks where only some rows are set to ``true`` ### What changes are included in this PR? C++...
### Describe the enhancement requested In many situations, it'd be beneficial to have an error Status which was copyable without using the heap. For example, this is a frequent pain...
For consistency with S3FileSystem and others. See discussion at https://github.com/apache/arrow/pull/13404#discussion_r901799543 **Reporter**: [Neal Richardson](https://issues.apache.org/jira/browse/ARROW-16884) / @nealrichardson **Note**: *This issue was originally created as [ARROW-16884](https://issues.apache.org/jira/browse/ARROW-16884). Please see the [migration documentation](https://github.com/apache/arrow/issues/14542) for further...
### Describe the bug, including details regarding any error messages, version, and platform. The k8s self-hosted runners solution is slightly flaky lately. See for example: - [centos-9-stream-arm64](https://github.com/ursacomputing/crossbow/actions/runs/11323884233/job/31487486171) - [ubuntu-jammy-arm64](https://github.com/ursacomputing/crossbow/actions/runs/11323885266/job/31487537394) -...
It's not possible to open a ``abfs://`` or `abfss://` URI with the pyarrow.fs.HadoopFileSystem. Using HadoopFileSystem.from_uri(path) does not work and libhdfs will throw an error saying that the authority is invalid...