numaflow
numaflow copied to clipboard
numaproj
Kubernetes-native platform to run massively parallel data/streaming jobs
We're observing a high number of control messages in multi-partition pipelines, which is affecting efficiency.
--- We need to verify the functionality of the Dedupe logic **Message from the maintainers**: Impacted by this bug? Give it a 👍. We often sort issues this way to...
https://github.com/awslabs/data-on-eks/issues/382 ```[tasklist] ### Tasks - [ ] https://github.com/numaproj/numaflow/issues/1092 - [ ] https://github.com/numaproj/numaflow/issues/1486 - [ ] Documentation - [ ] Example with an end-to-end use case ```
### E2E Testing 1. Add SDK tests for Python reducer. 2. Add tests for session reducer. ### Unit Testing 1. Add unit tests for numaflow-go reducer task managers. (use goleak...
2 asks, can be implemented in separate PRs - [ ] Today, the UI selects numa container by default, but it should be selecting user-container. - [ ] It should...
Debugging through UI is not helpful, especially when there are pod restarts or failing containers. We should show the following - [ ] pod restart count - [ ] restart...
https://github.com/numaproj/numaflow/pull/1437#discussion_r1442481038 Please fix for both aligned and unaligned windower implementations. --- **Message from the maintainers**: Impacted by this bug? Give it a 👍. We often sort issues this way to...
**Describe the bug** Pipeline stuck on init container unable to create any buckets/buffers on nats ISB service. There are other pipelines that are working fine on the same cluster. There...
A design doc on how to implement Pulsar ISB Service, which is supposed to how to manage the ISBs, any privileges needed, what is going to be used as k/v...
# Summary Node.js SDK implementation in https://github.com/numaproj/numaflow-js --- **Message from the maintainers**: If you wish to see this enhancement implemented please add a 👍 reaction to this issue! We often...