Junfan Zhang issues

Results 152 issues of


                                            Junfan Zhang

fix(spark): Strict check processed blockIds

### What changes were proposed in this pull request? Strict check processed blockIds ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? No. ### How...

[#2697] refactor(spark): Involve related writer stats info into ShuffleWriteTaskStats

### What changes were proposed in this pull request? Involve related writer stats info into ShuffleWriteTaskStats for further integrity validation block checksum implementation ### Why are the changes needed? for...

[FEATURE] Post failure reason when initializing shuffle writer + reader

### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) ### Search before asking - [x] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and found no...

[#2686] fix(client): Prefetch should be finished once shuffle result is empty or null

### What changes were proposed in this pull request? Prefetch should be finished once shuffle result is empty or null ### Why are the changes needed? fix #2686 ### Does...

[Improvement] Involve related stats of shuffle writer into the ShuffleWriteTaskStats

[FEATURE] Trigger partition split when the shuffle-server is unhealthy due to the insufficient capacity

good first issue

[Bug] Unnecessary multiple memory reading when prefetch is enabled

[FEATURE] Integrity validation for Gluten

[FEATURE] Make metadata of end-to-end integrity validation stored in the shuffle-server side

By leveraging the PR #2653 , we could end-to-end ensure the data consistency. But, the partition stats stored in the spark driver side, for the normal spark stages, this design...

[Improvement] Collect the partition lengths in ShuffleWriteTaskStats

good first issue