ClickBench icon indicating copy to clipboard operation
ClickBench copied to clipboard

The Pinot benchmark does not have indices.

Open didip opened this issue 3 years ago • 9 comments

I am not a user of Pinot so unfortunately I cannot help in this case.

But it seems like it should have indices.

didip avatar Oct 06 '22 01:10 didip

What indices to add?

alexey-milovidov avatar Oct 07 '22 23:10 alexey-milovidov

I have found that people from Pinot tried to add a benchmark version with indices but did not submit it: https://github.com/ClickHouse/ClickBench/compare/main...gortiz:ClickBench:main

alexey-milovidov avatar Feb 15 '23 14:02 alexey-milovidov

If you can take these changes and make them ready for a pull request, it will be helpful.

alexey-milovidov avatar Feb 15 '23 14:02 alexey-milovidov

@alexey-milovidov https://docs.pinot.apache.org/basics/indexing

Can you please bump up the pinot version to 0.12.1?

MacNale avatar Aug 04 '23 02:08 MacNale

Yes, ClickBench can install any version; please edit this file: https://github.com/ClickHouse/ClickBench/blob/main/pinot/benchmark.sh

Then you can send the results, or we can run it.

alexey-milovidov avatar Aug 04 '23 13:08 alexey-milovidov

okay.. Let me take a stab it. I am not a pinot expert. I am trying to evaluate Pinot vs clickhouse for my use case with my own data. This benchmark is a good start.

As per this blog 'https://startree.ai/blog/a-tale-of-three-real-time-olap-databases', pinot performs better than clickhouse. Nevertheless, let me read about pinot indexes before I come up with suggestions.

MacNale avatar Aug 09 '23 01:08 MacNale

We stumbled upon this article and found many factual errors and misrepresentations.

We did not find any reproducible scenario where Pinot can be faster than ClickHouse. Moreover, Pinot is much inferior in usability - you will find obstacles starting with installation and data loading.

alexey-milovidov avatar Aug 09 '23 01:08 alexey-milovidov