Jay Narale

The current Dataset is only 2-3Gb. Is there a bigger data set for 2TB or plans to make a new one

Based on the ticket https://issues.apache.org/jira/browse/CALCITE-5248

The time complexity for Adjacency List is O(VE)

## Description There must be a limit to restrict the volume of data generated by materialized CTE queries to prevent poorly designed queries from consuming excessive storage space and unrealistic...

These final files can be useful for Jmeter and other benchmarking tools. I also have around 2GB of data for each table which I can contribute as zip if needed

Fix parquet complex type handling

5

Fixes #7776 Parquet has notion of optional and repeated layers which is needed in arrow calls like [DefLevelsToBitmap](https://github.com/facebookincubator/velox/blob/7fc09667d5e22c684fdeff81da529b79cc974fee/velox/dwio/parquet/reader/PageReader.cpp#L573). This info is passed using arrow:LevelInfo. We were incorrectly computing **repeatedAncestor** by...

Fix Unaligned Memory Access for Footer Length in Parquet Reader

3

``` /home/user/presto-native/presto-native-execution/velox/velox/dwio/parquet/reader/ParquetReader.cpp:165:7: runtime error: load of misaligned address 0x7f4c5f982402 for type 'const uint32_t', which requires 4 byte alignment 0x7f4c5f982402: note: pointer points here 81 95 f8 5c 4a ce 06...

### Description CTE and exchange materialization rely on [pagefile](https://prestodb.io/docs/current/develop/serialized-page.html) readers and writers to create temporary tables. Sample java code for [reader](https://github.com/prestodb/presto/blob/522e095649344d02ffccebb7151f597f5ee5ed8d/presto-hive/src/main/java/com/facebook/presto/hive/pagefile/PageFilePageReader.java#L30).

The execution test for cte materialization for hive catalog [Test link](https://github.com/prestodb/presto/blob/master/presto-hive/src/test/java/com/facebook/presto/hive/TestCteExecution.java) does not test whether ctes are materialized and this test needs refactoring to do so ## Expected Behavior or...

Cost based CTE materialization

1

Currently only strategy `CteMaterializationStrategy.ALL` is supported i.e all ctes will be materialized. We need to support a cost based strategy which uses plan cost to determine materializable ctes. The action...