Ahmed Abualsaud

Default translation for SchemaTransforms

6

To make a PTransform upgradable, we need to write some translation logic for it (see [TransformPayloadTranslator](https://github.com/apache/beam/blob/d560aa63d58145546def09aba7db6f0c8f39dbe0/sdks/java/core/src/main/java/org/apache/beam/sdk/util/construction/PTransformTranslation.java#L631)). Essentially, this is logic that can: - translate a transform to its corresponding FunctionSpec...

add ExternalTransformProvider example

6

Adding an example for creating SchemaTransforms and using them with the ExternalTransformProvider API

Revert "Download BQMS catalog jar at build time"

2

Reverts apache/beam#32282

[Managed Iceberg] Allow updating partition specs at runtime

2

Users may update the table's spec while a write pipeline is running (e.g. streaming). Sometimes, this update can happen after serializing DataFiles. The partition spec is not serializable so we...

[Managed Iceberg] Cleanup SerializedDataFile; use ByteBuffer instead

3

We were using a workaround because of an issue in ByteBuddy (#32701). This has been fixed so we can now use ByteBuffer normally Note that this is an update compatible...

[Failing Test]: PreCommit Yaml Xlang Direct is broken

1

### What happened? Tests are [failing](https://github.com/apache/beam/actions/workflows/beam_PreCommit_Yaml_Xlang_Direct.yml?query=branch%3Amaster+is%3Acompleted) after #32757 was merged Failing tests are: - `apache_beam/yaml/integration_tests.py::MapTest::test_Filter-generic_InlineProvider_MapToFields-generic_ExternalJavaProvider_1` - `apache_beam/yaml/integration_tests.py::MapTest::test_Filter-generic_ExternalJavaProvider_MapToFields-generic_ExternalJavaProvider_3` Error (reformatted for readability): ``` FAILED apache_beam/yaml/integration_tests.py::MapTest::test_Filter-generic_InlineProvider_MapToFields-generic_ExternalJavaProvider_1 - apache_beam.testing.util.BeamAssertException: Failed assert: [Row(element=100, named_field=100,...