kanwang

[Core] GCS FT with redis sentinel

6

## Why are these changes needed? We want to use redis sentinel to support Ray GCS FT. I opened a ticket here: https://github.com/ray-project/ray/issues/46983. Redis sentinel should provide high availability without...

### Your current environment The output of `python collect_env.py` ```text (base) dog@ray-llama-70b-raycluster-sldjj-worker-l4-kwfzt:/tmp$ python ~/collect_env.py Collecting environment information... /home/ray/anaconda3/lib/python3.10/site-packages/_distutils_hack/__init__.py:26: UserWarning: Setuptools is replacing distutils. warnings.warn("Setuptools is replacing distutils.") PyTorch version: 2.5.1+cu124...

### What happened + What you expected to happen I tried serving a few mistral models like https://huggingface.co/mistralai/Devstral-Small-2505 or https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Base-2503. I've install are necessary dependencies (vllm==0.8.5.post1) but serving still wasn't...