pinot

pinot copied to clipboard

Query Cost Model and Usage

2

This JIRA tracks building a mechanism for identifying and computing the indicative cost of a query, based on parameters such as query complexity and data statistics (cardinality, selectivity etc). The...

atris

Adding ClientEncryptionS3PinotFS

5

https://docs.amazonaws.cn/en_us/sdk-for-java/v1/developer-guide/examples-crypto-masterkey.html To use client side encryption, you can specify either * `kmsCmkId` which contains the id of the KMS key as the value * `aesHexSecret` which contains a custom generated...

xiangfu0

Batch Ingestion from Delta Table

2

Currently, Pinot cannot perform batch ingestion from a [delta](https://delta.io/) table. It would be an excellent feature since the project is open-sourced and has many users. We can build a new...

athultr1997

Enhance Data Ingestion Engine

3

Motivation: - Offline segment generation and real-time in-memory consuming to on-disk committed segment conversion are very similar process, and they are both achieved by the same segment creation engine. We...

Jackie-Jiang

Close Pulsar consumer correctly when fetching offsets

1

Instructions: 1. The PR has to be tagged with at least one of the following labels (*): 1. `feature` 2. `bugfix` 3. `performance` 4. `ui` 5. `backward-incompat` 6. `release-notes` (**)...

KKcorps

Consider not performing alias rewrite to the rest of the query when alias is a column name

1

E.g. `SELECT SUM(a) AS a WHERE a > 10` will throw exception because it will be rewritten to `SELECT SUM(a) AS a WHERE SUM(A) > 10` Also, seems alias is...

Jackie-Jiang

Reducing Heap Memory Usage During Segment Construction

1

Segment construction is typically a heap memory intensive operation and there are opportunities to improve the same. This issue tracks the effort. cc @Jackie-Jiang

atris

Semantic of [ANY_VALUE](https://docs.snowflake.com/en/sql-reference/functions/any_value.html)

Jackie-Jiang

This adds support for distinct count hll pre-aggregation. It introduces a new property on the fieldSpec, fixedLength in bytes so that BYTES data type can be treated as fixed length...

priyen

Support multi-valued dimensions in the StarTree index

3

Currently, the star-tree index can not be used with multi-valued dimensional columns. The problem with supporting multi-valued columns in the split order of the star-tree index is that the behaviour...

lksvenoy-r7