Keshi Dai

[Feature] Make Replicas field in WorkerGroupSpec optional

3

### Search before asking - [X] I had searched in the [issues](https://github.com/ray-project/kuberay/issues) and found no similar feature requirement. ### Description The [Replicas field](https://github.com/ray-project/kuberay/blob/master/ray-operator/api/raycluster/v1alpha1/raycluster_types.go#L46) in `WorkerGroupSpec` is currently required. This field...

[Feature] Authn and Authz support for KubeRay API server and CLI

1

### Search before asking - [X] I had searched in the [issues](https://github.com/ray-project/kuberay/issues) and found no similar feature requirement. ### Description There's no Authn and Authz support for KubeRay in the...

Thanks to @ClaireMcGinty ! BeamDataflowJobTask is added to luigi 2.8.5 (https://github.com/spotify/luigi/blob/2.8.5/luigi/contrib/beam_dataflow.py). We could use it to replace `PythonDataflowTask`

When user launches a python beam job for tft or stats generation, they can still specify `--requirements_file` to install `spotify-tensorflow`, which we know it'll cause problem because of tfdv package....

Need a proper helper function that works both local and gs path to replace `os.path.join`

Remove pyarrow dependency upper bound cap

1

Pyarrow dependency has been capped at [

Fixes https://github.com/tensorflow/data-validation/issues/238

The latest numpy release 1.24.0 broke TFDV

3

TFDV allows ['numpy>=1.16,