spark-rapids icon indicating copy to clipboard operation
spark-rapids copied to clipboard
verified publisher icon NVIDIA

[FEA] Improve nds performance of iceberg.

Open liurenjie1024 opened this issue 1 month ago • 2 comments

liurenjie1024 avatar Nov 26 '25 00:11 liurenjie1024

Hi @liurenjie1024 , can you be more specific about current performance and what we are going to do to improve performance?

sameerz avatar Dec 01 '25 03:12 sameerz

Hi @liurenjie1024 , can you be more specific about current performance and what we are going to do to improve performance?

On our spark2a cluster we are 2.x compared with oss cpu version. We need to investigate it and at least catch up with spark rapids's performance advantage compared with oss spark on pure parquet.

liurenjie1024 avatar Dec 01 '25 06:12 liurenjie1024