roryqi
roryqi
> With my limited experience, I think s3 is a good choice in this issue. > > If we choose to support s3, then it will easily extend to other...
@jiafuzha Do you have extra input?
> > We can merge them. We can refer to the implement of Celeborn. It's sure that we need consider more things like AQE. > > I think you don't...
@xianjingfeng 1. Do you use object storage? 2. Why should we consider if we use object storage? 3. I see #407, you seems that you occur the problems when you...
For object storage, I prefer adding list operation for shuffle server like `listShuffleFiles`. Because object storage's list operation usually have poor performance. It's better for object if we merge data...
Our index and data format is like  We can merge them into one file ``` blockNum blockId1 offset crc compress length uncompress length taskId blockId2 offset crc compress length...
> Do we support higher versions of JDK here, like JDK 21? @qijiale76 We don't support high version now.
> > We don't support high version now. > > I have run Uniffle on JDK 21 and didn't find any issues. I think Uniffle is compatible with JDK 21...
> I don't think we need to support all versions of the JDK, the user should configure it according to their own environment. But the docker image is using JDK11,...
@qijiale76 Could you update the description? @zhengchenyu @xianjingfeng Could you help me review this pull request?