Brian Hulette

WIP: Use Batched DoFns in DataFrame convert utilities

4

TODO: - [x] Get tests passing - [x] Clarify separation of concerns between pandas_type_compatibility and dataframe.schemas - [x] Address TODOs (mostly error string comments) - [x] Remove duplicated logic in...

Minor: Add helpful names for parameterized tests in `dataframe.schemas_test`

2

GitHub Actions Tests Status (on master branch) ------------------------------------------------------------------------------------------------ [](https://github.com/apache/beam/actions?query=workflow%3A%22Build+python+source+distribution+and+wheels%22+branch%3Amaster+event%3Aschedule) [](https://github.com/apache/beam/actions?query=workflow%3A%22Python+Tests%22+branch%3Amaster+event%3Aschedule) [](https://github.com/apache/beam/actions?query=workflow%3A%22Java+Tests%22+branch%3Amaster+event%3Aschedule) [](https://github.com/apache/beam/actions?query=workflow%3A%22Go+tests%22+branch%3Amaster+event%3Aschedule) See [CI.md](https://github.com/apache/beam/blob/master/CI.md) for more information about GitHub Actions CI.

Add support for FLOAT to Python RowCoder

6

Part of #19815 This adds support for encoding the schema type FLOAT to Python's RowCoder. This is added in a new coder, `SinglePrecisionFloatCoder`, designed to be compatible with Java's `FloatCoder`....

### What happened? Java uses `FloatCoder` for encoding the FLOAT type, which encodes as a 4 byte single-precision floating point number. Go currently shunts FLOAT through the same path as...

We use yapf in Apache Beam's Python SDK, and occasionally I run into an issue where yapf will not break a breakable line that's longer than the column limit and...

Get DSCOVR image at current time

4

It looks like an entire days-worth of DSCOVR images are dumped at once, delayed by a day or two. So the "latest" image is typically just the last image for...

WIP: Test DataFrame API with pandas 1.5.0

1

Fixes #22847 GitHub Actions Tests Status (on master branch) ------------------------------------------------------------------------------------------------ [](https://github.com/apache/beam/actions?query=workflow%3A%22Build+python+source+distribution+and+wheels%22+branch%3Amaster+event%3Aschedule) [](https://github.com/apache/beam/actions?query=workflow%3A%22Python+Tests%22+branch%3Amaster+event%3Aschedule) [](https://github.com/apache/beam/actions?query=workflow%3A%22Java+Tests%22+branch%3Amaster+event%3Aschedule) [](https://github.com/apache/beam/actions?query=workflow%3A%22Go+tests%22+branch%3Amaster+event%3Aschedule) See [CI.md](https://github.com/apache/beam/blob/master/CI.md) for more information about GitHub Actions...

### What needs to happen? We should test more nested, structured types (Optional[row], Sequence[row], etc..). Missing that coverage allows issues like https://github.com/apache/beam/issues/22854 to slip through. ### Issue Priority Priority: 2...

Fix assertion failure when calling decompress multiple times

3

- Add a test that emulates the calling pattern in https://github.com/apache/beam/issues/22939 - Address the assertion failure by checking size of `unused_data` (please advise if there's a better solution here)

Should the specification (or maybe a best practices document #223) recommend GeoParquet producers omit file- and page-level statistics for WKB-encoded columns? Consumers cannot interpret these statistics in a meaningful way,...