enrich

enrich copied to clipboard

Upgrade fs2-kafka to 3.5.1

2

oguzhanunlu

Add incomplete events

7

This PR adds incomplete events to Enrich flow. Before, enriching an event [was resulting](https://github.com/snowplow/enrich/blob/4.0.0/modules/common/src/main/scala/com.snowplowanalytics.snowplow.enrich/common/enrichments/EnrichmentManager.scala#L69) in either a `BadRow` or an `EnrichedEvent`. What's new is that now a `BadRow` [can have](https://github.com/snowplow/enrich/blob/incomplete_events/modules/common/src/main/scala/com.snowplowanalytics.snowplow.enrich/common/enrichments/EnrichmentManager.scala#L69)...

benjben

benjben

oguzhanunlu

prepared based on schemas of schema_violation and enrichment_failures

oguzhanunlu

pondzix

Additional logging

1

Additional DEBUG logs: - Log the size of the biggest event of a chunk (an event being a collector payload that can contain several actual events) - Log how many...

benjben

Common: add tests for required property that is explicitly set to nul…

1

dilyand

Had to reproduce a test for RDB Shredder (https://github.com/snowplow/snowplow-rdb-loader/issues/238), thought it would be great to contribute back.

chuwy

**Project**: Stream Enrich **Version**: 3.8.2 **Expected behavior**: Enricher should mark the event as invalid and not log anything. **Actual behavior**: Enricher marks the event as invalid, but also logs the...

marcin-j