Joris Borgdorff

Exactly, that's the point. So for example absolute locations, IP addresses or unprocessed voice data are privacy sensitive. However, we could choose to store them in encrypted way. The platform...

Another alternative is to do the data processing on another "trusted" host, where we would provide the decryption key as well. Right now, I don't think we have the budget...

As long as the HR and Acc is not coupled to a specific person, I'd consider them anonymised data, which would be fine to process if we don't know the...

Viewer: http://ahn.maps.arcgis.com/apps/webappviewer/index.htmlhttp://ahn.maps.arcgis.com/apps/webappviewer/index.html?id=c3c98b8a4ff84ff4938fafe7cc106e88 Overview: http://www.ahn.nl/pagina/viewer.html

Well the partitioner in the HDFS connector is aimed at Avro compatibility, whereas this proposal would create a more complex partioner.

Good temporary fix. My hunch is that CPU usage is dominated by garbage collection, indeed because the streams take too much memory. Once the new sampling method in RADAR-Backend is...

Increasing `commit.interval.ms` should help then, as this controls how often a state store is flushed (to JSON). Perhaps this value should depend on the time window: if 1 week, not...

So far, the Confluent part is set up, but that is only the data ingestion. Step by step: - sensor interface: I'm collaborating with @MaximMoinat to define an API for...

Since we add timestamps to all messages, I'd opt for **at least once** processing to start, we can always establish unicity by the timestamp. It may be harder to retrieve...

I see no problem in using the connector with CP 5.0.0 brokers. However we do not have a code update planned at this point in time. You are more than...