quickwit

quickwit copied to clipboard

Long transaction in PostgreSQL when marking large number of splits for deletion

5

When marking a large number of splits for deletion, MetaStore(PostgreSQL) experiences long-running transactions that cause database lock contention and performance degradation. The `mark_splits_for_deletion` operation processes all splits in a single...

earlbread

### Description Document the `max_file_descriptors` option that controls the maximum number of file descriptors for cached splits. Closes #4953. ### How was this PR tested? N/A

earlbread

Corrupt split after merge

4

I am running git sha `2025-09-21T06:01:37.990Z INFO quickwit_cli::service: quickwit version: 0.8.0 (x86_64-unknown-linux-gnu 2025-09-12T14:57:53Z ef6b319)` and keep running into data corruption ``` Error: { "message": "internal error: `search failed for the...

shrijeet

### Description Describe the proposed changes made in this PR. ### How was this PR tested? Describe how you tested this PR.

PSeitz

gcp pubsub source: at_least_once

2

### Description Following on https://github.com/quickwit-oss/quickwit/pull/3720 and https://github.com/quickwit-oss/quickwit/pull/3744 for https://github.com/quickwit-oss/quickwit/issues/1107 - [x] implements the missing `check_connectivity` - [x] Goal of this PR, is to support `at_least_once` delivery, and add test for...

AyWa

fmassot

### Description Describe the proposed changes made in this PR. ### How was this PR tested? Describe how you tested this PR.

PSeitz

- Added a list of available environment variables in the docker installation section - Updated `node-config.md` to add the environment variables to the respective config option @guilload The idea is...

evanxg852000

Added a guide on timestamp pruning guide Closes https://github.com/quickwit-inc/devrel/issues/3

evanxg852000

Closes #2493

boraarslan