Junfan Zhang

I have a question that why it will influence the dynamic allocation? Could u help give more detail? I think a shuffle dependency will hold a shuffle handle(rss or sort...

As i know, partition assignment policy could be implemented by yourself.

Oh, the bug of https://github.com/Tencent/Firestorm/pull/187 is caused by me. Maybe I can take this ticket, could u help assign this to me?

@colinmjj @jerqi > For spark client, it can depend on spark's implementation, and read data according to delegation token. yes. There is no need to retrieve fs by ugi proxy...

@jerryshao You have caught my thoughts and thanks very much for explaining it in detail. Sorry I didn't explain clearly in advance. So I think using the super user to...

> Now our Uniffle already support multiple HDFS. Is it possible to use the secured hdfs cluster and unsecured hdfds cluster? And some configuration may be added to RemoteStorageConfItem. >...

Updated. @jerqi. Besides, i think i will introduce some ITs later.

> @zuston To access secured DFS, I think the process should be: > > 1. get remote storage from coordinator > 2. register remote storage to shuffle server with **user...

> Access to secured clusters and isolation of user shuffle data are orthogonal, you can still do the isolation in a non-securere cluster (using the proxy user way in your...

Updated the description and submit a simple proposal (https://docs.google.com/document/d/1pIDwCwv8iwnXmFQeTZKA5tK55SRc_f0SPKYFONA5K70). Feel free to discuss or comment more. @jerqi @jerryshao @duanmeng @colinmjj Besides if the uniffle community has a public proposal confluence...