pinot
pinot copied to clipboard
apache
Apache Pinot - A realtime distributed OLAP datastore
# ZooKeeper Contention and Linear Performance Degradation with High-Parallelism Batch Ingestion ## Environment - **Pinot Version**: apachepinot/pinot:latest - **Deployment**: Kubernetes - **Cluster Size**: 1 Controller, 1 ZooKeeper, 3 Brokers, 3...
Summary Resolves Issue [17045](https://github.com/apache/pinot/issues/17045) This PR fixes an issue where an exception in fetchPartitionCount, often caused by a deleted topic, would halt ingestion for an entire multi-topic table. By catching...
Today, server status `Alive` just means it has a `liveinstance` and is connected to the cluster. We should incorporate something like `/health` or `shutdownInProgress` into the UI status so it's...
Currently, partial results are not returned, and if one or more servers fail, the query is marked as a failure. Since returning query stats is recently supported in the timeseries...
Justification -- The ensureAllPartitionsConsuming function validates and repairs LLC (Low-Level Consumer) realtime segments to ensure all stream partitions have active consuming segments. It's called by the RealtimeSegmentValidationManager periodic task to...
* Add upsert table support with segment validation and filtering * Add integration test case for upsert workflow with multi-year data Issue: https://github.com/apache/pinot/issues/16359
## Summary Issue link : https://github.com/apache/pinot/issues/15675 🚀 What this PR delivers   🔄 Typical flow Create Query...
- Extend the SQL parser, PinotQuery thrift schema, and request contexts with `ArrayJoin*` objects and parsing logic for the new `ARRAY JOIN` syntax. - Add integration with the planner and...
This PR adds a validation framework for Pinot transform functions used in ingestion configs. It provides validation hooks for datatype checks in the TransformFunction interface that individual functions can implement...
The createStream() call in this test is incurring recurring costs in CI. The test is retained for manual use. Note that the test only runs when AWS secrets are loaded...
