Jay Narale

Thank you! I will begin work on breaking down components, creating PR's for them and making this production ready, along with a more detailed analysis of performance of temporary tables,...

And a design doc to start now

I've put together a proposal that's been inspired and based on the paper http://www.vldb.org/pvldb/vol8/p1704-elhelw.pdf, which was recommended by @rschlussel. I'm hoping we could discuss it and improve the idea further....

@kaikalur @rschlussel @ClarenceThreepwood @bmckennaah what do you think about this approach? - [link](https://docs.google.com/document/d/10J9_j08imqe6xEH9iepteG0DA5B-IpmYv4lSRvCgdJA/edit)

@rschlussel Unfortunately nope, kind of got sidetracked by other tasks due to the estimated work and ROI for this one but we plan to dedicate some resources this half. Interested...

We are starting POC development based on the design and will have something this quarter

've prepared the POC - accessible here: [link](https://github.com/prestodb/presto/pull/20887/files). Currently only 1 persistent cte is supported, i am working on supporting multiple + dependent. Initially, we executed tpcds query 4 and...

We don't see these errors with parquet format for temp tables. The speed is around 5x slower though. 10% queries failed with hive bad data. ( **..__presto_temporary_table_PARQUET_20231010_035817_00498_9ghcq_e13e9b33_cdbd_49f5_a6ff_fcf613f2f4b6/000000_0_20231010_035817_00498_9ghcq is not a...

I debugged with deletion off, The pagefile file was non empty. It happens with parquet too. **..__presto_temporary_table_PARQUET_20231010_035817_00498_9ghcq_e13e9b33_cdbd_49f5_a6ff_fcf613f2f4b6/000000_0_20231010_035817_00498_9ghcq is not a valid Parquet File", "cause": { "type": "com.facebook.presto.parquet.ParquetCorruptionException", )** I inspected...

So my suspicion was now on 2 things. 1) HDFS inconsistency 2) Some grouped execution changes not being picked up in my patch I introduced a 1-second pause after the...