numaflow
numaflow copied to clipboard
Kubernetes-native platform to run massively parallel data/streaming jobs
# Summary Implement Apache Pulsar as an ISB Service - do not need to support built-in installation, but external service configuration is good enough. - [ ] #1451 - [...
# Summary source-transformer might return -1 watermark for a message in a batch. since we also take min of watermarks, we will end up publishing -1 watermark which will be...
**Describe the bug** While publishing the message with future event-time, watermark value shows -ve but value is not correct, in below watermark `1702656650194` in an hour in future but displaying...
While creating Pipeline / ISB in the UI, in case of a long error while validating / submitting, the buttons overflow the container
Here are some feedback that we should consider for the documentation we have currently for NumaFlow . - We should follow the basic structure in https://github.com/argoproj/argo-workflows -Which provides uber level...
# Summary When a source vertex (e.g. Kafka) has very low traffic, it might end up with a very low avg processing rate, and then a sudden backlog (pending) comes,...
# Summary We need to have an E2E test for UI features. # Use Cases When would you use this? --- **Message from the maintainers**: If you wish to see...
current UI, there is no way to display pod logs for - jobs (might be transient. If issue is there, it might be long running) - deamon services - pod...
# Summary I would like to use this pattern: https://www.enterpriseintegrationpatterns.com/patterns/messaging/Aggregator.html What change needs making? # Use Cases I would like to be able to group messages based on their number...
# Summary need basic RED metrics (requests, errors and latency) for numaflow apis # Use Cases When would you use this? when numaflow UI is served in production environment, admin...