enrich
enrich copied to clipboard
Remove the possibility to emit enriched events invalid against atomic schema
Remove the feature flag acceptInvalid in the configuration and consider it as always false.
acceptInvalid and invalidCount can be removed from these 2 functions :
- In EnrichmentManager :
def enrichEvent[F[_]: Monad: RegistryLookup: Clock](
registry: EnrichmentRegistry[F],
client: Client[F, Json],
processor: Processor,
etlTstamp: DateTime,
raw: RawEvent,
acceptInvalid: Boolean,
invalidCount: F[Unit]
): EitherT[F, BadRow, EnrichedEvent] =
- In EtlPipeline :
def processEvents[F[_]: Monad: RegistryLookup: Clock: HttpClient](
adapterRegistry: AdapterRegistry,
enrichmentRegistry: EnrichmentRegistry[F],
client: Client[F, Json],
processor: Processor,
etlTstamp: DateTime,
input: ValidatedNel[BadRow, Option[CollectorPayload]],
acceptInvalid: Boolean,
invalidCount: F[Unit]
): F[List[Validated[BadRow, EnrichedEvent]]] =
More details here.