Kenn Knowles comments

Results 148 comments of


                                            Kenn Knowles

[Bug]: Portable Spark 3 Streaming runner appears to have GBK bugs, cannot execute Redistribute composite correctly

I notice that the portable Spark runner sickbays tests that would probably catch this too: ``` excludeTestsMatching 'org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests' ```

[Bug]: Portable Spark 3 Streaming runner appears to have GBK bugs, cannot execute Redistribute composite correctly

Ah and the equivalent ReshuffleTest

Remove `gradle-wrapper.jar` from source tree

This seems like a mostly-benign change. It is also fine to simply exclude the jar from the source release zip (I'm actually surprised if this is not already the case)....

Remove temporary KafkaSourceDescriptor.create function

I think they may be both serialized to the graph _and_ shipped in Kafka SDF using SerializableCoder (haven't checked). So, yes, this could be an issue.

Remove temporary KafkaSourceDescriptor.create function

Yea it is pretty hard to test. You would have to start a pipeline with the released version of the SDK and then use this version of the SDK to...

[Java]Fix infinite retry issue in BigQuery getDatasetLocation() for non-existent datasets

waiting on author

[Managed Iceberg] Cleanup SerializedDataFile; use ByteBuffer instead

On your other PR I basically suggested what you did here. What was the issue?

[Managed Iceberg] Cleanup SerializedDataFile; use ByteBuffer instead

Update-incompatible?