enrich

enrich copied to clipboard

Stream: emit a generic_error bad row when an uncaught exception is sent to Sentry

1

At the moment no bad row is emitted when an uncaught exception is thrown by Common Enrich (e.g. `NullPointerException`).

benjben

Common: deprecate and remove CloudfrontLoader

2

AWS is changing its Cloudfront format. > We are contacting you because your AWS account contains at least one CloudFront web distribution with logging enabled. Starting December 12, 2019, Amazon...

chuwy

Common: make EnrichedEvent a case class

2

Today [EnrichedEvent](https://github.com/snowplow/common-enrich/blob/master/src/main/scala/com.snowplowanalytics.snowplow.enrich/common/outputs/EnrichedEvent.scala) is a mutable class whose `@BeanProperty` fields get updated a lot, which is very non-functional and prone to errors. From https://github.com/snowplow/snowplow/issues/4121

benjben

It appears we've changed the class but forgot to update the scaladoc: ``` /** * Contains enrichments based on IAB Spiders&Robots lookup. * @param ipFile (Full URI to the IAB...

dilyand

CallRail adapter was added [ages ago](https://github.com/snowplow/common-enrich/commit/f14779adf41012bd4bf886b4725c3d7234176904) (https://github.com/snowplow/snowplow/issues/1108), but only with GET requests support, although docs claimed it does support POST.

chuwy

Common: add Anonymous IP Enrichment

3

Schema: https://github.com/snowplow/iglu-central/pull/1055 MaxMind IP Lookups PR: https://github.com/snowplow/scala-maxmind-iplookups/pull/133

chuwy

Allow configuration of rule for when derived_tstamp should default to collector_tstamp.

4

We have seen issues in the past where derived_tstamp can be very wrong value due to changing clocks in between the two `dvce` tstamps, changing timezones, and now, more recently,...

colmsnowplow

Proposal: wrap enrich.good and enrich.bad events in an CNCF CloudEvents spec cloudevents.io envelope. This can be used to provide distributed tracing and other metadata to the messages in the queue....

julianbei

Common: write out Avro format rather than TSV

4

chuwy

Common: wrap EnrichedEvent POJO in self-describing Avro

2

chuwy