pinot
pinot copied to clipboard
Apache Pinot - A realtime distributed OLAP datastore
Inspired by presto array functions(https://prestodb.io/docs/current/functions/array.html), we can first support those transform functions on multi-value to 1 value result. * [x] array_average * [x] array_max * [x] array_min * [x] array_sum...
Currently, the StandardAnalyzer is used. This analyzer removes special characters, so if users wanted to search for them, it would not work. It would be useful to allow the user...
Helps fixing #9045 This flag can be used to control whether exceptions thrown by the decoder should be ignore. For example, at the moment the CSV decoder throw an exception...
Bumps [error_prone_annotations](https://github.com/google/error-prone) from 2.3.4 to 2.15.0. Release notes Sourced from error_prone_annotations's releases. Error Prone 2.15.0 New Checkers: BuilderReturnThis CanIgnoreReturnValueSuggester CannotMockFinalClass CannotMockFinalMethod DirectInvocationOnMock ExtendsObject MockNotUsedInProduction NoCanIgnoreReturnValueOnClasses NullArgumentForNonNullParameter SelfAlwaysReturnsThis UnsafeWildcard UnusedTypeParameter Fixed...
Part of a series of PRs for Pinot Upsert Optimizations. Check [this doc](https://docs.google.com/document/d/124TSQ6ZRFRZd6uEAZpq98E68eBh0fmHYLvERzXtmKjk/edit#) out for Upsert TTL and Snapshot Design Heap memory usage is one of the pain point for...
(cherry picked from commit 8806dc35ecd09297c72d987b80f37b190dd7974e) Original PR - #8972 ### Supported configs * `descriptorFile` - Path of the descriptor file. You can generate this file use `protoc -o file.desc --include_imports...
Since we cut release-0.11.0 candidate branch, we have introduced several bug-fixes (list of new commits [here](https://github.com/apache/pinot/compare/release-0.11.0...master)), and several of them are critical because we recently upgraded several dependencies. I checked...
`RealtimeToOfflineSegmentsTask` does not honor `maxNumRecordsPerTask`, so it will generate only one sub-task per time bucket. In a table with high ingestion rate, each time bucket may contain >100M records, and...
Currently, when folks try to compile pinot with any other version than java11, they get cryptic error messages. The PR adds check in enforcer plugin and triggers before any compilation...
Currently, multi-stage engine doesn't support many of the broker pre-processing logic, we should support: - [x] REALTIME/OFFLINE split support (https://github.com/apache/pinot/pull/9379) - [ ] broker side pruning logic support - [...