pinot

pinot copied to clipboard

Bumps [org.apache.httpcomponents.core5:httpcore5](https://github.com/apache/httpcomponents-core) from 5.3.6 to 5.4. Changelog Sourced from org.apache.httpcomponents.core5:httpcore5's changelog. Release 5.4-alpha1 This is the first ALPHA release in the 5.4 release series that improves HTTP/2 protocol support by...

dependabot[bot]

Improve splitPart function

2

The split part function ([link](https://github.com/apache/pinot/blob/58e5c4afa8ef3f46f20c0a125469d40f5741ceab/pinot-common/src/main/java/org/apache/pinot/common/function/scalar/StringFunctions.java#L553)) is allocation-heavy. It first calculates all splits and then only returns the one indexed as requested by its argument. That is very allocation expensive when...

gortiz

Incorrect deletion of valid upsert segments due to replica-level validDocIds inconsistency during merge-compaction and server restarts

5

### Description: We observed data loss in a FULL upsert table caused by an incorrect segment-deletion decision during the UpsertMergeCompactionTask. Two segments (S1, S2) existed across two servers and were...

tarun11Mavani

Add Row-Level Security (RLS) Support for ZooKeeper-Based Authentication (#17220)

6

This commit extends Row-Level Security (RLS) functionality to ZooKeeper-based authentication (`ZkBasicAuthAccessControlFactory`), enabling dynamic user management with table-level filter controls via REST API. Previously, RLS filters were only supported with file-based...

NihalJain

Add post-partial-upsert transforms for derived columns

1

This pull request adds support for applying post-update transform functions after partial upsert merges in Pinot. This enables derived columns to be recomputed based on the latest merged row, enhancing...

xiangfu0

Optimize DistinctCountHLL aggregation for high-cardinality dictionary-encoded columns

4

## Problem The DISTINCTCOUNTHLL aggregation function suffers from severe [performance degradation ](https://github.com/apache/pinot/blob/f46f631ce179c9cb152b9846f580f01f4ffa33ae/pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/DistinctCountHLLAggregationFunction.java#L107)when processing high-cardinality dictionary-encoded columns (14 Million). Profiling shows that 50% of CPU time is spent in RoaringBitmap operations:...

praveenc7

Support exact decimal value to preserve precision

2

### Core Fix in RequestUtils.java __File__: `pinot-common/src/main/java/org/apache/pinot/common/utils/request/RequestUtils.java` __Line 238__: Replaced the precision-losing code with: ```java // Store exact decimal value to preserve precision literal.setBigDecimalValue(BigDecimalUtils.serialize(bigDecimalValue)); ```

Akanksha-kedia

Improve exception handling in ControllerLeaderLocator

2

This is in the convertToHostAndPortPair method which is responsible for parsing instance IDs like "localhost_9000" into hostname and port pairs. The current implementation has poor exception handling and could fail...

Akanksha-kedia

Revert Upsert Metadata of a segment during Inconsistencies

1

Continuation to: https://github.com/apache/pinot/pull/17144 This PR is a long term fix without having to disable reload on consuming segment/force commit for Partial Upserts and Tables with dropOutOfOrder=true. In this PR, the...

deepthi912

Set SSL context in ControllerContext/BrokerContext/ServerContext

1

xiangfu0