numaflow
numaflow copied to clipboard
numaproj
Kubernetes-native platform to run massively parallel data/streaming jobs
# Summary Currently, in order to facilitate the CI of our SDKs efficiently, we use local references in the dependency management files of the examples. If a user just copies...
might fix #1551 #1554 We would need to ensure that there are no adverse consequence in the handling of the new write error that would happen in the surge scenario.
https://github.com/numaproj/numaflow-java/issues/96
This PR proposes adding a retryInterval setting to pipeline and vertex manifests, with the default set to 1ms. Reasons for increasing the retryInterval beyond the default include reducing spammy logs...
how do we quantify the reliability, availability, and performance of a Numaflow pipeline? While pipelines differ in their business objectives, what are the common denominators of core / key metrics...
In the User-defined source, I would like to have the ability to do a clean shutdown of the resources on Shutdown/Sigterm events. In the current interface, I do not see...
**Describe the bug** I have noticed a few times that messages could disappear in very specific conditions. I accidentally discovered how to reproduce the issue in my pipelines. I apologize...
https://github.com/numaproj/numaflow/issues/1551 https://github.com/numaproj/numaflow/issues/1551#issuecomment-1991223266
# Summary Have a python UDF that does sentiment analysis on a stream of text messages. It was hard to test the UDF locally to see if it works or...
