Vigith Maurice
Vigith Maurice
# Summary There lot of users asking for how to easily integrate a new source. We can implement a Python User-Defined-Source and make it available in https://github.com/numaproj/numaproj-demo # Use Cases...
# Summary We need to improve the UI a bit, it cannot be a straight line
Currently read-batch-size at pod level (at a vertex) is computed as ``` partition-read-batch = read-batch-size pod-read-batch = read-batch-size * partition count ``` i.e., if we set 300 as batch-size and...
we need to enable after fix batch-map in numaflow-rs _Originally posted by @vigith in https://github.com/numaproj/numaflow/pull/2925#discussion_r2324030675_
We had implemented parts of autoscaling - [x] stop autoscaling once the pipeline/mvtx has reached max token size - [x] we at the minimum should document the behavior (DONE) -...
# Summary Jetstream 2.10 is now in maintenance mode, 2.12 is available in preview mode. We need to run endurance test on Jetstream 2.11. # Use Cases Use 2.11 for...
Can I ask you to extend the docs for [Watermarks](https://numaflow.numaproj.io/core-concepts/watermarks) and [Back pressure](https://numaflow.numaproj.io/specifications/overview/#back-pressure), describing the behaviour for multiple sources, joins and keyed streams. ## Context idleness was not set for...
# Summary Document how can one implement a custom source by implementing the gRPC proto definitions
# Summary Currently we are not using [MessageMetadata](https://github.com/numaproj/numaflow/blob/796d0f1b3c2a71fa9daa6fb77658a0b282ac85a1/pkg/apis/proto/isb/message.proto#L39-L42), we have to expose `num_delivered` even when ISB is not involved. --- **Message from the maintainers**: If you wish to see this...
# Summary There is need for passing some context between "processors" (Source, Map, Sink, Transformer, and Reduce) so that these meta information can be used by subsequent vertices (including during...