parseable

parseable copied to clipboard

Adding `.schema` to S3 prefix has an issue

1

Parseable mistakenly adds a `/` while creating a `.schema` file or other `.` files inside the log stream prefix. ``` Aug 27 14:19:46 parseable-server minio[743764]: Error: Object name invalid: parseable/app//.schema...

nitisht

On handlers for endpoints, instead of using HttpResponse as return type it should be replaced with Result. This change is tied up to #2 and can't be implemented without these...

trueleo

Currently data directory is created when new stream is added but if data directory is deleted then it causes event processing to fail. `failed to process event because io error:...

trueleo

Currently the server uses `aws-sdk-s3` while Datafusion has a dependency on `object-storage` crate that uses `rusoto`. We need to unify and use a single S3 client in both the places...

nitisht

Metadata management flow

1

Current `STREAM_INFO` map may have an issue with parallel writes to the map for the same stream. 1. We need to implement a locking mechanism that allows exclusive writes to...

nitisht

It is not possible to query fields with capitals names

1

Query is case sensitive, so we need to avoid modifying query string while processing the query.

nitisht

on RUST_LOG=warn there are bunch of these warnings ``` aws_smithy_client::builder] Retries require a `sleep_impl`, but none was passed into the builder. No retries will occur with the current configuration. If...

nitisht

Fixes #XXXX. ### Description Adds code to manage time periods within which the alert rule is valid. Possible loopholes: The current behavior only considers first event only for setting `period_end`,...

de-sh

Errors are of two major types: 1. Server error - to be logged on to the Parseable console. 2. API error - to be sent to the user as API...

nitisht

We need to implement an effective algorithm that can take care of situations where local data and data on S3 is out of sync.

nitisht