logisland
logisland copied to clipboard
Hurence
Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex ev...
# Expected behavior and actual behavior. Metrics have not been properly ported to the Structured Streams implementation. This should be fixed. # Steps to reproduce the problem. # Specifications like...
# Expected behavior and actual behavior. - The engine should support the Duplication(Fork) of records (to different topics) - The engine should support the Join of records (from different topics...
# Expected behavior and actual behavior. We want the streams to be able to write in several topics (based on conditions). This means we have to rewrite the different Sinks...
# Expected behavior and actual behavior. We want to be able to run pipelines in multiple environments (Spark, Flink, Java bare metal in an application). At the moment the pipelines...
# Expected behavior and actual behavior. We need to clean and remove some verbosity in the pipelines We also need to add an include mechanism to make things more modular...
# Expected behavior and actual behavior. Tests should be reworked and the framework to run them should be revisited. If we use the github infra we cannot run all tests....
# Expected behavior and actual behavior. Old versions of Spark are not supported anymore as well as old versions of some data sources. We should clean the code for these...
# Expected behavior and actual behavior. We want to split the core engine and the data sources for build reasons # Steps to reproduce the problem. # Specifications like the...
# Expected behavior and actual behavior. If we do not have a proper editor we would probably at least want some proper metrics and a panel for visualizing the pipelines...
...as a structured stream service to allow reading/writing to/from Azure event hubs (through AMQP).
