Sanskar Modi

Uneven distribution of data in partitions

1

We were trying to run a count query on a public bigquery dataset (with 65GB data / 185,666,648 rows) with this connector. And noticed that initial tasks were taking around...

[LIVY-988] Support for escaping backtick from spark-submit arguments

5

## What changes were proposed in this pull request? Fixes - #415 Adding support for escaping backticks from spark-submit arguments. - This feature will be behind a flag `livy.server.escapeBackTicks` (default:...

Escape backtick from spark-submit arguments

3

Currently, livy does not escape backticks from user-provided spark-submit arguments. So if a customer is passing any arguments that contain backticks, it will be considered as command substitution during spark-submit...

[Spark 3] RSS performance with Adaptive Skew Join Optimization

3

Current support of RSS with AQE framework does not provide performant APIs for AQE skew join optimization. To explain more, when AQE detects a skew partition it tries to divide...

sys_perf_event_open: Invalid argument

1

``` At event 14/32 sys_perf_event_open: Invalid argument ``` I'm getting this^ on running example code in `src/libperf_example.c`

[CELEBORN-1536] Add option to toggle between human friendly vs single line logging

6

### What changes were proposed in this pull request? Adding option to choose between human friendly vs single line logging. Currently changes are done only for `WorkerInfo` and `StorageManager`. I...

[CELEBORN-1550] Add support of providing custom dynamic store backend implementation

8

### What changes were proposed in this pull request? Adding support of providing custom dynamic store backend implementation, users can now pass there own implementation for dynamic config store backend....

[CELEBORN-1617][CIP-11] Support workers tags in FS Config Service

1

### What changes were proposed in this pull request? Adding support for reading worker tags in FSConfigService. (Will handle DBConfigService in separate PR). Tags will be part of System level...

[CELEBORN-1582] Publish metric for unreleased shuffle count when worker was decommissioned

8

### What changes were proposed in this pull request? Adding a worker metrics for publish unreleased shuffle count when worker was decommissioned. ### Why are the changes needed? Currently celeborn...

[CELEBORN-1620][CIP-11] Support passing worker tags via RequestSlots message

1

### What changes were proposed in this pull request? Supporting passing tag expression in RequestSlots request. Clients can pass the tags using CelebornConf. Default tag configs for system/tenant/user will be...