Kenn Knowles comments

Results 148 comments of


                                            Kenn Knowles

Google Cloud Storage TextIO read fails with gz-files having Content-Encoding: gzip header

Thanks for the updates. Seems like the thing that would make this "just work", at some cost on the Dataflow side but saving bandwidth, would be option 3. This should...

Google Cloud Storage TextIO read fails with gz-files having Content-Encoding: gzip header

I haven't thought about this in a while, but is there a problem with always passing `Accept-encoding: gzip` ?

[Feature Request]: Manage GCS soft delete policy in temp location

What is the status here?

[Feature Request]: Manage GCS soft delete policy in temp location

I am asking because it is targeting 2.57.0 release. Are we able to cherry-pick? Or is it good enough having some functionality on 2.57.0 branch?

[Feature Request]: Manage GCS soft delete policy in temp location

SGTM

Portable runners should be able to issue checkpoints to Splittable DoFn

Since this is new functionality I think that P2 is the right level. This is still an important priority for portable runners to function properly with SDF.

Portable runners should be able to issue checkpoints to Splittable DoFn

CC @chamikaramj since tagged with xlang

Portable runners should be able to issue checkpoints to Splittable DoFn

The expansion happens before the job is launched. It isn't per-worker.

The PostCommit XVR Spark3 job is flaky

It still flakes sometimes but is much better than our flakiness threshold.

[Feature Request]: Support Jackson 2.15

Yes, that could make sense if we currently have a dep conflict that will block important uses. What is the resolution proposal?