Junfan Zhang

icon indicating a website link zuston.vercel.app icon indicating an email [email protected]

icon location shanghai icon location PMC of @apache Uniffle and the maintainer of @tony-framework

Results 434 comments of Junfan Zhang

[Improvement] Collect the partition lengths in ShuffleWriteTaskStats

> can you assign to me please go ahead. assigned

[FEATURE] Make metadata of end-to-end integrity validation stored in the shuffle-server side

The second step is to implement the server side logic to accept and return back the partition stats. If anyone have interest on this, feel free to take this.

[#2697] refactor(spark): Involve related writer stats info into ShuffleWriteTaskStats

> @zuston Some copilot comments are useful. You can take a look. yes. all done

[Bug] The deserialization Read of the Shuffle Read line failed

What type of RPC is being used?