Sanskar Modi comments

Results 40 comments of


                                            Sanskar Modi

[Spark 3] RSS performance with Adaptive Skew Join Optimization

Thanks @jerqi for replying, this sounds like the exact problem that we're facing. Although after reading the docs I'm a little confused about how exactly Uniffle is storing the data....

[CELEBORN-914] Support memory file storage

@FMX metrics added by this PR is not added to the Celeborn website [Monitoring](https://celeborn.apache.org/docs/latest/monitoring/) page. Also, should we start adding such changes in the release notes as well. WDYT?

[CELEBORN-1451] HPA support

@lianneli This is a great feature. On what metrics it will upscale/downscale. Is there any document for this?

[LIVY-988] Support for escaping backtick from spark-submit arguments

cc: @pralabhkumar

[LIVY-988] Support for escaping backtick from spark-submit arguments

@pralabhkumar PTAL

[CELEBORN-1620][CIP-11] Support passing worker tags via RequestSlots message

@FMX @zwangsheng Need help on how can i generate getter/setter methods for Protobuf messages.

[CELEBORN-1620][CIP-11] Support passing worker tags via RequestSlots message

ping @FMX @zwangsheng @mridulm

Escape backtick from spark-submit arguments

cc: @pralabhkumar

Escape backtick from spark-submit arguments

I'm working on this.

[CELEBORN-1550] Add support of providing custom dynamic store backend implementation

@SteNicholas We have an internal implementation of config management service which enforce authn/authz and constraints on specific configs. It also helps us manage the rollout better between different regions.