numaflow
numaflow copied to clipboard
Kubernetes-native platform to run massively parallel data/streaming jobs
```[tasklist] ### Numaflow Tasks - [x] Update MonoVertex Source Transformer - [x] Update Pipeline Source Transformer ``` ```[tasklist] ### SDK Tasks - [x] Golang - [ ] Python - [...
The PR aims to provide a generic API to run PromQL to fetch metrics for the UI. The overall goal is to improve debuggability experience for platform and application engineers.
```[tasklist] ### Tasks - [ ] api for showing Sink Invocation Latency for a Monovertex - [ ] api for filtering the time series by time - [ ] api...
**Describe the bug** This is based on having run Numaplane using the rc 20 and rc 21 images that @whynowy built for me [here](https://quay.io/repository/numaio/numaflow-rc?tab=tags). What are these images? He built...
Merge once https://github.com/numaproj/numaflow-python/pull/191 is merged
Fixes #2083 I simply swapped 1. the Job creation to occur prior to 2. the creation/deletion/Update of the Vertex CRs. Previously the creation of the Jobs was dependent on the...
# Summary Pave a path for including builtins into MonoVertex # Use Cases support Builtins --- **Message from the maintainers**: If you wish to see this enhancement implemented please add...
# Summary Create [custom resource action](https://argo-cd.readthedocs.io/en/stable/operator-manual/resource_actions/#custom-resource-actions) to pause and unpause Pipelines and MonoVertex resources. # Use Cases We want to support pausing through ArgoCD. --- **Message from the maintainers**: If...
Display the sink invocation [latency](https://github.com/numaproj/numaflow/blob/ac7b33b803c2530df6c7f24252fb4e714c9bd07f/rust/numaflow-core/src/monovertex/metrics.rs#L61) and end to end processing [latency](https://github.com/numaproj/numaflow/blob/ac7b33b803c2530df6c7f24252fb4e714c9bd07f/rust/numaflow-core/src/monovertex/metrics.rs#L57) metrics (P99, P95, P90, P50) for a monovertex in the Numaflow UI for default time period of 30 mins.