processor_tda: Add documentation for processor_tda

[cosmo0920]

Corresponding to https://github.com/fluent/fluent-bit/pull/11250.

Summary by CodeRabbit

• New Features

  • Added a TDA-based processor that analyzes metric streams and exports topology-based metrics (Betti numbers) to assist anomaly and regime detection.

• Documentation

  • New processor documentation covering configuration options (windowing, embedding, thresholds), processing overview, interpretation of Betti metrics, and configuration examples.

_{✏️ Tip: You can customize this high-level summary in your review settings.}

[coderabbitai[bot]]

[!WARNING]

Rate limit exceeded

@cosmo0920 has exceeded the limit for the number of commits or files that can be reviewed per hour. Please wait 8 minutes and 21 seconds before requesting another review.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

📥 Commits

Reviewing files that changed from the base of the PR and between fc6e1b29d62c6b208c714a47108886f2b55084df and 14290e61a60599bfe633a7833166ab6436a0972f.

📒 Files selected for processing (1)

• pipeline/processors/tda.md (1 hunks)

Walkthrough

Added documentation for a new Topological Data Analysis (TDA) processor: pipeline/processors.md lists "TDA" and a new pipeline/processors/tda.md documents the processor, its configuration, processing pipeline, exported metrics, and examples (Betti 0–2 via Ripser).

Changes

Cohort / File(s)	Summary
Processors overview pipeline/processors.md	Added a new "TDA" entry to the processors list referencing the TDA-based processor.
TDA processor docs pipeline/processors/tda.md	New documentation describing the tda processor: configuration options (window_size, min_points, embed_dim, embed_delay, threshold with defaults), processing steps (aggregation, normalization, sliding window, optional delay embedding, distance matrix, threshold selection), Ripser integration for persistent homology (H0–H2), exported metrics (fluentbit_tda_betti0, fluentbit_tda_betti1, fluentbit_tda_betti2), interpretation guidance, and example YAML snippets.

Sequence Diagram(s)

sequenceDiagram
    autonumber
    participant FluentBit as Fluent Bit pipeline
    participant TDA as TDA Processor
    participant Ripser as Ripser PH Library
    participant Exporter as Metrics Exporter

    FluentBit->>TDA: emit aggregated/normalized metrics (sliding window)
    TDA->>TDA: optional delay embedding -> distance matrix -> threshold selection
    TDA->>Ripser: compute persistent homology (H0..H2)
    Ripser-->>TDA: persistence intervals / Betti counts
    TDA->>Exporter: expose metrics (`fluentbit_tda_betti0/1/2`)
    Exporter-->>Monitoring: scrape/collect metrics

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~20 minutes

• Verify the documented parameter names and defaults in pipeline/processors/tda.md match the implementation.
• Confirm metric names and exporter conventions for fluentbit_tda_betti0/1/2.
• Check Ripser integration description (H0–H2) and threshold selection modes correspond to actual code or dependency requirements.
• Review examples/YAML for accurate field names and formatting.

Possibly related PRs

• fluent/fluent-bit-docs#2183 — Updates processor listings in pipeline/processors.md; likely overlaps with placement/formatting of the new TDA entry.

Poem

🐰 I hop through metrics, curious and bright,
Counting loops and holes into the night.
Betti numbers hum a hidden tune,
Ripser maps shapes beneath the moon,
Docs now bloom — we chase patterns in light. ✨

Pre-merge checks and finishing touches

✅ Passed checks (3 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title clearly and specifically describes the main change: adding documentation for the processor_tda component.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[cosmo0920]

@eschabell I supressed vale errors on my written doc. How do we proceed further revising on this?