pinot

pinot copied to clipboard

https://github.com/apache/pinot/pull/9171 added support for query cancelation This is a bit more complex in multi-stage engine as there are multiple stage in various distributed machines. This issue tracks the effort to...

walterddr

Explore alternative to LBuffer for larger than 2GB buffers

4

For off heap buffers (direct or mmap'd), we currently use Lbuffer library if the size is more than 2GB (which is supported for raw forward index by the v3 and...

siddharthteotia

Query Processing Resiliency

11

To make our query processing pipeline resilient to failures (like server slowness, crashes, etc), we can make some improvements in the broker and server components. I am working on a...

vvivekiyer

Improving Query Preemption on Brokers/Servers

6

Currently, the broker/server pre-empt a query at certain points during scheduling/execution based on timeOut. However, this is not sufficient for a couple of use-cases. Few examples: - When a user...

jasperjiaguo

Problem === Currently we do not split data table when size is too large. thus we set the default GRPC channel msg size to 128MB. however this is still an...

walterddr

Enable Consistent Data Push on Ingestion Jobs for REFRESH use case

1

Consistent data push protocol APIs are available via controller REST APIs such as `startReplaceSegments`, `endReplaceSegments`, and `revertReplaceSegments`. However, previously, ingestion jobs are not wired to use this feature. Introduce a...

yuanbenson

Make broker short-circuit for point queries w/ a limit clause

6

We've observed `select` and `select distinct` queries with no aggregation and a small limit clause can take a long time to process. We think that the broker is waiting for...

dang-stripe

[Feature] List files from inputDir with recursive option based on inputFilePatterns in IngestionJobLauncher

2

61yao

Add Referencing feature in TLS config to reduce the duplicated rows

3

## Description Adds reference feature to TLS config loading. Now we can use `xxxx.tls.ref=` to simply ask TLSUtils to load TLS settings from the same config file. - It is...

dongxiaoman

Table selector won't work if table name is null

5

https://github.com/apache/pinot/blob/d1d2ddbc116f6dddbefdf1e69dd409434eaae0e4/pinot-clients/pinot-java-client/src/main/java/org/apache/pinot/client/Connection.java#L86-L94

LaroLuo