Thomas Newton

Pyarrow dataset scan can't handle schema evolved nested structs

11

# Environment **Delta-rs version**: 0.10.1 **Binding**: Python **Environment**: - **Cloud provider**: Azure - **OS**: Ubuntu 20.04 - **Other**: pyarrow 13.0.0 *** # Bug **What happened**: Exception is raised when trying...

Support `python.analysis.nodeExecutable` in `.vscode/settings.json` and with `${workspaceFolder}` templating

5

`python.analysis.nodeExecutable` was recently added and it seems to be a big help. Thank you for adding it. I would like to be able to configure it in our repo so...

Addresses: https://github.com/physical-computation/sunflower-embedded-system-emulator/issues/196

There are a list of packages mentioned in step 1 of the sunflower-toolchain readme. These seem to be required to build the cross compiler but they are not mentioned in...

[C++][FS][Azure] Expose parallel transfer config options available in the Azure SDK

9

### Describe the enhancement requested Optimisation to https://github.com/apache/arrow/issues/37511 Child of https://github.com/apache/arrow/issues/18014 When reading from Azure blob storage the bandwidth we get per connection is very dependant on the latency to...

GH-39345: [C++][FS][Azure] Add support for environment credential

1

### Rationale for this change Maybe be useful to support explicit environment credential (currently environment credential can be used as part of the Azure default credential flow). ### What changes...

[C++][FS][Azure] Azure CLI authentation

5

### Describe the enhancement requested Child of https://github.com/apache/arrow/issues/38598 Add support for Azure CLI auth. Should work on any system where you have run `az login`. https://github.com/Azure/azure-sdk-for-cpp/blob/main/sdk/identity/azure-identity/src/azure_cli_credential.cpp ### Component(s) C++

[C++][FS][Azure] Environment credential authentication

3

### Describe the enhancement requested Child of https://github.com/apache/arrow/issues/38598 Environment credential is the same as [client secret](https://github.com/apache/arrow/issues/39343) except it extracts the important values from standard environment variables instead of just arguments...

[C++][FS][Azure] Optimise `ObjectAppendStream::DoAppend` in the case of many small appends

6

### Describe the enhancement requested Optimisation to https://github.com/apache/arrow/issues/38333 Child of https://github.com/apache/arrow/issues/18014 Currently `ObjectAppendStream::DoAppend` calls `block_blob_client_->StageBlock` synchronously meaning that the call to `ObjectAppendStream::DoAppend` blocks until the data has been successfully written...