Chao Sun

icon indicating a website link http://sunchao.github.io icon indicating an email [email protected]

icon company @openai @apache icon location Sunnyvale icon location Member of @apache. Committer of Spark, Hadoop, Arrow, DataFusion, and Hive. Likes databases, distributed systems, and programming languages.

Results 91 comments of Chao Sun

[SPARK-54596][CORE][K8S] Burst-aware Memory Allocation Algorithm for Spark@K8S

Yea, I think it'll be useful to have a lightweight SPIP for this feature. In particular we can share experiences of running this in prod at Pinterest, motivations, etc. The...