Robert Bradshaw comments

Results 76 comments of


                                            Robert Bradshaw

trafficstars

[YAML] Add the ability to pre-process yaml files with jinja2.

Given the uncertainty with what's going on here, another option is to put the changes in to the dataflow template itself in the short term.

Clear side input caches of dofninvoker when finishing bundle. Add microbenchmarks for map_fn with side inputs.

I agree, and this will likely slow things down a lot more on a real runner without SDK cache than is shown in the microbenchmarks. How hard would it be...

Better mixed Java/Python error messages for external transforms.

Any more concerns before getting this merged?

Add a test for sql dialect.

R: @shunping

Add a test for sql dialect.

Ping?

Default SchemaTransform configs to snake_case

@chamikaramj would this impact using the transform service cross-version?

Basic yaml-defined provider.

R: @Polber

Basic yaml-defined provider.

Ping @Polber

Avoid length-prefix-bytes substitutions for Flink boundaries.

Yes, this is ready for review. Would you be willing to take a look.

Avoid length-prefix-bytes substitutions for Flink boundaries.

R: @kennknowles