roryqi comments

Results 407 comments of


                                            roryqi

fix: strictly verify whether app is registered especially after server restart

We should modify the method from ``` public StatusCode registerShuffle( String appId, int shuffleId, List partitionRanges, RemoteStorageInfo remoteStorageInfo, String user, ShuffleDataDistributionType dataDistType, int maxConcurrencyPerPartitionToWrite) { refreshAppId(appId); ShuffleTaskInfo taskInfo = shuffleTaskInfos.get(appId);...

[#1119] improvement: Explicitly throw `BUFFER_LIMIT_OF_HUGE_PARTITION` instead of `NO_BUFFER`

We should catch ` BufferLimitOfHugePartitionException` in the `ShuffleServerGrpcService` and log the information of the exception.

[Umbrella] Introducing `Cli` to update the configuration file

> > > > If it's ok, I will go ahead. Gently ping. @jerqi @zuston @kaijchen @advancedxy > > > > > > > > > I think cli is...

[Spark 3] RSS performance with Adaptive Skew Join Optimization

@s0nskar The data distribution of reduce partition is important. Otherwise the reader will suffer from random IO according to our experience in the Uniffle (another remote shuffle service implement similar...

[FEATURE] support use skip list to store shuffleBuffer in memory

We need to guarantee the order of data, otherwise we will lose the data.

[Umbrella] Refactor BlockId semantics

One concern is that it may occupy too much memory if we use Map to store blockIds instead of bitmap.

[Umbrella] Release 0.9.0

@EnricoMi Maybe we could to start to release 0.9.0-rc1.

[#1706] improvement: Upgrade the default NodeJS and npm versions of dashboard.

Merged to master.

[#3342] feat(core): Refactor the role and privilege model

https://docs.starburst.io/latest/security/biac-privileges.html