enrich
enrich copied to clipboard
snowplow
Snowplow Enrichment jobs and library
ATM if there is a problem when processing the HTTP response sent by the service (e.g. "error_str": "exhausted input"`), bad row doesn't contain this response, make it hard to troubleshoot
It's getting requested by multitenant users https://github.com/snowplow-incubator/snowplow-google-analytics-plugin/issues/23, https://discourse.snowplowanalytics.com/t/snowplow-google-analytics-plugin-does-not-send-app-id/2224
Right now we ignore JSON Schema `default` property because there's no best place to substitute it (in Enrich or during Loading). We can make it a configurable enrichment to fill...
**Project**: Stream Enrich **Version**: 1.3 and upper **Expected behaviour**: Releases for enricher should be available as jar files on Bintray. **Actual behaviour**: It's not clear what's the intended goal of...
In many IO-heavy enrichments we use cache (LRU mostly): * Weather enrichment * Currency conversion * IP Lookups * API Request * SQL Query * ~Referer parser enrichment~ (loads everything...
In https://github.com/snowplow/snowplow/issues/3857 we added support for POSTs, but [functions we use](https://github.com/snowplow/enrich/blob/85ce299623f68244cf1dd7251287982be8b8eb17/modules/common/src/main/scala/com.snowplowanalytics.snowplow.enrich/common/enrichments/registry/apirequest/Input.scala#L198-L215) still try to stringify the payload as it was GET, whereas sending plain object instead of string in POST...
**Project**: Common **Version**: 1.3.2 **Reason**: Nashorn is deprecated as of [JEP335](https://openjdk.java.net/jeps/335) and will be removed in JDK 15 as per [JEP372](https://openjdk.java.net/jeps/372). It is suggested that switching to [GraalVM](https://www.graalvm.org/) Community Edition...
`DecodeBase64UrlSpec` sometimes fails with something like: ``` Error: x decodeBase64Url should not return failure on any other string Error: Falsified after 94 passed tests. Error: > ARG_0: "ON" Error: >...
```scala Loader[T] { def toCollectorPayload( line: T, processor: Processor ): ValidatedNel[BadRow.CPFormatViolation, Option[CollectorPayload]] ``` The function signature indicates that several `CPFormatViolation` bad rows can be emitted for one `CollectorPayload`, whereas it...
At the moment the event and its contexts are validated at the beginning and then the contexts added by the enrichments are validated, but given that some enrichments can update...