kellen

Estimate the size of input collections and allow users to configure (rough) numBytes rather than numShards. I propose dropping `numShards` completely. Also propose dropping special handling of "unsharded" sparkey and...

Annotated BQ classes are transformed into case classes but the plugin lacks the `copy` method so IntelliJ reports an error

``` import com.google.protobuf.Any // if imported, will throw a coder error below case class A(userId: Int) object Job { def main(cmdlineArgs: Array[String]): Unit = { implicitly[com.spotify.scio.coders.Coder[A]] } } ``` Throws:...

Internal spotify discussions suggest that the default `maxPendingRequests=1` may no longer be a good default and a higher value (e.g. `6`) may make more sense for batch. We should write...

Managed + Iceberg IO

2

Adds support for Beam's managed transforms and for Iceberg, which is implemented as a managed transform. Note this is on a snapshot of magnolify, will need a release before merge.

Update CI to publish automatically

1

Releases are currently manual

Vendor chill

2

I looked into whether importing some subset of chill was reasonable but most of the various chill deps are kryo serializers or registrars, so appear to be required for our...

[Do not merge] v0.15.0

1

non-draft status for CI