pinot
pinot copied to clipboard
apache
Apache Pinot - A realtime distributed OLAP datastore
#8491 introduced the FailureDetector module. We want to add documentation for it
During the execution of the Upsert Compaction task, we perform a three-way equality check of CRCs from different sources of truth: ([Ref](https://github.com/apache/pinot/blob/7dbb05d2ee921f1a1b127a4c10bfd4ba168c5114/pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/upsertcompaction/UpsertCompactionTaskExecutor.java#L78-L84)). - Segment ZK Metadata CRC: This is pushed...
I have not yet explored how schema or index updates affect the CRC mismatch issue in Upsert compaction. I'm adding this as a task in the parent issue so we...
During the UpsertCompactionTaskGenerator, we check whether the ZK metadata CRC of a segment matches the CRC we fetch from the validDocID bitmap response from the servers ([Ref](https://github.com/apache/pinot/blob/55f6a6f6d46ca92d2e7ca65a6c1e67de5738cfe7/pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/upsertcompaction/UpsertCompactionTaskGenerator.java#L232-L237)). If a scenario...
We already have INSERT INTO operation in Pinot ```` INSERT INTO events FROM FILE 's3://marks-st-cloud-bucket/events/' OPTION( taskName=events-task, includeFileNamePattern=glob:**/*.json, input.fs.className=org.apache.pinot.plugin.filesystem.S3PinotFS, input.fs.prop.accessKey=AKIARCOCT6DWLUB7F77Z, input.fs.prop.secretKey=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, input.fs.prop.region=eu-west-2 ); ```` It would be nice to support...
This is a meta-issue to track memory protection mechanism in multi-stage. Specifically, the following mechanisms are included in single-stage query engine but are not present in multi-stage: - #13433: killing...
For unnest query support in v2: ``` SELECT a.col1, col22 FROM a CROSS JOIN UNNEST(a.col2) AS t(col22) ``` - [X] Sql -> SqlNodeAndOption - [X] SqlNodeAndOption -> StageNode (Query Plan)...
Instructions: 1. The PR has to be tagged with at least one of the following labels (*): 1. `feature` 2. `bugfix` 3. `performance` 4. `ui` 5. `backward-incompat` 6. `release-notes` (**)...
We have a realtime table (_6 partitions, 140gb),_ when querying the table with timeout of 3 minutes all servers (6 servers, each 24cores and ~100 gb allocated to pinot) OOM...
