arrow
arrow copied to clipboard
Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
### Describe the bug, including details regarding any error messages, version, and platform. As part of writing a Flight integration test client for .NET (#44361) I ran into a limitation...
### Describe the enhancement requested Hey, I'm opening this issue to suggest a possible performance improvement for the `pa.Table.from_pylist` method. Below is a script where I create a table from...
### Describe the enhancement requested Free-threaded wheels on Windows were blocked on the availability of NumPy packages. Those are now available in https://anaconda.org/scientific-python-nightly-wheels/numpy/files Reference: https://github.com/numpy/numpy/issues/26157#issuecomment-2414471900 ### Component(s) Packaging, Python
### Rationale for this change This is a continuation of https://github.com/apache/arrow/pull/43196 In https://github.com/apache/parquet-format/pull/240 a GEOMETRY logical type for Parquet is proposed with a proof-of-concept Java implementation ( https://github.com/apache/parquet-java/pull/1379 ). This...
### Describe the bug, including details regarding any error messages, version, and platform. **Environment** OS: Windows/Linux Python: 3.11.2 Pyarrow: 17.0.0 Pandas: 2.2.2 **Description** When trying to read a timestamp value,...
### Describe the enhancement requested Can support for struct type columns be added to the hash_list aggregation function. For my particular use case I'd use it to create nested structures...
There are two not-nullable constraints in the Java implementation of MapVector: 1. Map data should be a non-nullable struct type; https://github.com/apache/arrow/blob/d4516c5386f84619dfdf2a9f72fed6d7df89704c/java/vector/src/main/java/org/apache/arrow/vector/complex/MapVector.java#L98 2. Map data key type should be a non-nullable;...
### Describe the bug, including details regarding any error messages, version, and platform. > Uninstalling benchmarks-0.1.0: > Would remove: > /Users/Nok_Lam_Chan/miniconda3/envs/kedro/lib/python3.10/site-packages/benchmarks-0.1.0.dist-info/* > /Users/Nok_Lam_Chan/miniconda3/envs/kedro/lib/python3.10/site-packages/benchmarks/* > Would not remove (might be manually...
### Describe the enhancement requested It would be nice to have another step up from `promote_options="permissive"`, e.g., `promote_options="union"` which uses dense unions when columns are heterogeneous across schemas. For example:...
### Describe the bug, including details regarding any error messages, version, and platform. Minimal failing unit test: ```diff diff --git a/cpp/src/arrow/io/buffered_test.cc b/cpp/src/arrow/io/buffered_test.cc index cbf2c2cf0..98cabdaf1 100644 --- a/cpp/src/arrow/io/buffered_test.cc +++ b/cpp/src/arrow/io/buffered_test.cc @@...