Neville Li
Neville Li
Right now they only cast underlying `SCollection`, which might not work for mixing `SCollection`s of ADTs. https://github.com/spotify/scio/blob/main/scio-core/src/main/scala/com/spotify/scio/values/SCollection.scala#L294 https://spotify-foss.slack.com/archives/C015189TFDH/p1620769273059800
We have a feature request that metric mutation e.g. `counter.inc()` should fail with a meaningful message when called outside of a pipeline (a lambda). This is probably a beam issue....
Need to look at the implications. ```scala def timestampBy(f: T => Instant, allowedTimestampSkew: Duration = Duration.ZERO): SCollection[T] = this.applyTransform(WithTimestamps.of(Functions.serializableFn(f)) .withAllowedTimestampSkew(allowedTimestampSkew)) ``` https://issues.apache.org/jira/browse/BEAM-644
Right now we have `SCollection#sample` which uses a Beam transform and is implemented as a global combine operation. It'll be nice to have a sample into side output variation that...
Instead of encode `method@{Source.scala:123}` in transform names.
Which might solve permission issues when compiling code that uses BigQuery macros. https://cloud.google.com/bigquery/docs/share-access-views
https://github.com/protocolbuffers/protobuf/releases/tag/v3.12.0
Please give feedback on the entire collection of Koans overall: - Structure - Continuity - User experience - Missing topics - What else? And on individual Koans: - Too easy/hard?...
- [x] `DoFn` - [x] `combine/aggregate` with mutation - [x] Approximate algorithms - [ ] More join/cogroup Koans - [x] Java vs Scala primitives
The following test fails with a message like "! Nested.nested: Gave up after only 7 passed tests. 501 tests were discarded.". ```scala object NestedArbitrarySpec extends Properties("Nested") { private val ok...