Noel Kwan
Noel Kwan
In streaming workload, high join amplification can lead to barrier latency spike. So far our approaches to mitigate these have been more indirect, e.g. decoupling sink, adaptive rate limit. It...
Tracking for: https://github.com/risingwavelabs/risingwave/issues/13481 - [x] Fix the output blocking ratio metrics. https://github.com/risingwavelabs/risingwave/pull/18219 - https://github.com/risingwavelabs/risingwave/blob/4d0a2010145417f1a2e0766b39e98dbe55c98bbe/src/meta/src/dashboard/prometheus.rs#L150 - https://github.com/risingwavelabs/risingwave/blob/4d0a2010145417f1a2e0766b39e98dbe55c98bbe/src/stream/src/executor/dispatch.rs#L126-L130 - Perhaps we can consider the "no metrics" case as though blocking is 100%....
Rough idea: The patch changes are often minimal. Perhaps incremental compile can help somehow. Let @huangjw806 investigate https://depot.dev/ first. If that works well we won't need this.
> @BugenZhao We may investigate if it's possible to inspect the back-pressure metrics next time so we can find which fragment is slow at a single glance. :lark-cry: Await-tree has...
https://github.com/risingwavelabs/risingwave/issues/18176 can work in most cases. But consider when the blocking duration is an hr. There can be no throughput or actor blocking duration metrics at all, and the graph...
The metrics tracked here need to be fine-tuned as they have too high granularity. Either they need to be changed from actor to fragment level, or a backup metric in...
- [x] #18097 - [ ] #13481. This is also slow, because we have to manually read the await-tree and find the bottleneck.
See instructions on running these tests here: https://github.com/risingwavelabs/risingwave/pull/15612#issuecomment-2295562069. Just need to open a PR and add these labels.
Now that we support approx percentile, perhaps we can support streaming `percentile_cont` via `approx_percentile` too, by simply setting relative_error to 0. Most of the work just needs to take place...
I hereby agree to the terms of the [RisingWave Labs, Inc. Contributor License Agreement](https://gist.github.com/TennyZhuang/f00be7f16996ea48effb049aa7be4d66#file-rw_cla). ## What's changed and what's your intention? As per title. ## Checklist - [ ] I...