Devdutt Shenoi

Hi, I was wondering if it would be a good idea to add a method `blackboard_owned` as follows: https://github.com/Sollimann/bonsai/commit/c78ea1689cd62784ac310431c161e6036d475a50 The idea is to get rid of an unnecessary `clone()` call...

unit-tests to validate working of specialized flattening code

1

Can we add tests to better document the expectations we wish to be fulfilled by this code _Originally posted by @de-sh in https://github.com/parseablehq/parseable/pull/1196#pullrequestreview-2625652941_

Replace `Vec<item>` with `HashMap<id, item>` for filter and dashboard listing

1

Unlike in the case of [correlations](https://github.com/parseablehq/parseable/pull/1115/files#diff-9365947de13fa1baeffe58418f99128e8a1e778cf89b2fb11524e69fb553c0b5L44-L46), both [dashboards](https://github.com/parseablehq/parseable/blob/main/src/users/dashboards.rs#L111) and [filters](https://github.com/parseablehq/parseable/blob/main/src/users/filters.rs#L73) continue to use `Vec`. This should change in order to help with improving the codebase as most usage involves lookup...

Store path URL in about API response is wrong for s3

2

`/about` output: ```json { "version": "v1.7.1", "uiVersion": "v0.9.15", "commit": "8f1a1d5", "deploymentId": "01J7FFVWBWASYTBVD3A250V21P", "updateAvailable": true, "latestVersion": "v1.7.2", "llmActive": true, "llmProvider": "OpenAI", "oidcActive": true, "license": "AGPL-3.0-only", "mode": "Distributed (Query)", "staging": "", "hotTier":...

We need to require custom partitioning to be strict, disallowing keys/values that contain special characters. This requires that the custom partitioning should adhere to not have name/values that aren't alphanumeric....

Allow configuring parseable instance with a toml file

3

Currently, parseable configs are extracted from env variables, this could become simpler if configs can be extracted from a TOML file.

Kafka improvements

1

1. Integration Tests: - [ ] Add tests using test containers to simulate Kafka. 2. Documentation: - [ ] Getting started with kafka ingestor on parseable - [ ] System...

> Similar issues are also seen in the case of running tests in #1047 => [ref](https://github.com/parseablehq/parseable/actions/runs/13063219327/job/36489367801#step:10:840) > > _Originally posted by @de-sh in [#1152](https://github.com/parseablehq/parseable/issues/1152#issuecomment-2628033806)_

bug: ingestions fail to take place after sync failure

1

`/about` output: v1.6, distributed mode Description: Ingestion API returns 200, but events aren't in s3. Logs show retries reaching limit(5): ``` 2024-11-18T18:13:43Z WARN parseable::sync] failed to sync local data with...