Xiang Fu

Adding Apache Pinot Query Runner

13

## What type of PR is this? - [ ] Refactor - [ ] Feature - [ ] Bug Fix - [X] New Query Runner (Data Source) - [ ]...

Support Pinot with secure connection

2

## Description Support pinot TLS connection to controller/broker. This can be enabled by ``` pinot.tls.enabled=true ``` ## Release notes ```markdown # Pino Support TLS connection via the `pinot.tls.enabled` configuration property....

Adding examples of jmx exporter for Apache Pinot

2

https://pinot.apache.org https://github.com/apache/incubator-pinot Sample output: ``` # HELP pinot_server_realtime_exceptions_requestDeserialization_MeanRate Attribute exposed for management ("org.apache.pinot.common.metrics"MeanRate) # TYPE pinot_server_realtime_exceptions_requestDeserialization_MeanRate untyped pinot_server_realtime_exceptions_requestDeserialization_MeanRate 0.0 # HELP pinot_server_llcControllerResponse_UploadSuccess_FifteenMinuteRate Attribute exposed for management ("org.apache.pinot.common.metrics"FifteenMinuteRate) # TYPE pinot_server_llcControllerResponse_UploadSuccess_FifteenMinuteRate...

Reduce docker image size

3

The current pinot docker image size is pretty large, 1GB after 0.10.0 release. This is majorly due to the shaded plugins. ``` 144K plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone 144K plugins/pinot-batch-ingestion 87M plugins/pinot-environment/pinot-azure 87M plugins/pinot-environment...

Current pinot supports environment variables override for table config template. We should also add the support and convention for system properties, as that is much simpler to use and set...

Support Array function for multi-value columns

5

Inspired by presto array functions(https://prestodb.io/docs/current/functions/array.html), we can first support those transform functions on multi-value to 1 value result. * [x] array_average * [x] array_max * [x] array_min * [x] array_sum...

Adding ClientEncryptionS3PinotFS

5

https://docs.amazonaws.cn/en_us/sdk-for-java/v1/developer-guide/examples-crypto-masterkey.html To use client side encryption, you can specify either * `kmsCmkId` which contains the id of the KMS key as the value * `aesHexSecret` which contains a custom generated...

Support pinot proxy for pinot controller, broker and server grpc traffic routing.

3

## Description Pinot proxy is used as the global user-facing endpoint to handle all controller/broker HTTP requests as well as server gRPC requests for Trino. This is a must when...

Allow submiting ingestionJobSpec yaml to launch minion task for ingestion job

1

Currently, users run this command to ingest data: `pinot-admin.sh LaunchIngestionJob -jobSpec my-ingestion-job-spec.yaml`. The goal is to make users can re-use the same yaml for segment ingestion in minion. Steps: 1....

Replicate table with different config

1

Use case: a table is bootstrapped already, however we want to test if how much perf boost partitioning a column will bring. The only solution now is to create a...