advancedxy

Gently ping @andygrove @viirya, do you have any more comments?

Thanks all for reviewing, @andygrove @viirya @kazuyukitanimura @parthchandra

FYI, I'm working on this.

I'm +1 for this direction in the long term and I can help review the Iceberg integration if needed. In the short term, I think Iceberg could integrate Comet in...

> @advancedxy Good suggestions. I believe this Issue is to address point 3 above while 1 and 2 are in progress. Thanks for the clarification, it makes totally sense then.

As an umbrella issue, If you are going to make a list of frequently used expressions, maybe you can add the hash expressions(which I created #205 earlier) as one of...

> I was thinking to add Spark Scan OneRowRelation scan support in addition to Parquet Scan. I am adding RowToColumnar support in #206. Once it's done, I think it's trivial...

> Another potential solution we can do is to transform OneRowRelation and to use DF PlaceholderRowExec Of course, that would be more performant and straightforward.

> Basic idea is to grab queries from https://spark.apache.org/docs/latest/api/sql/index.html and create a separate task in Comet which will check if the Comet being triggered. Hmmm, I think you can get...

> In particular, the glibc version used to compile and build Comet must be compatible (i.e., older) than the version used to execute Comet. In the native world, it usually...