Ruiyang Wang

Results 81 comments of Ruiyang Wang

[Data] Ray Data doesn't account for object store memory from object dtypes

Now https://github.com/ray-project/ray/pull/45071 is merged, Data can use it to get object size

Add secret_env_vars to runtime-env parameter of job submission

cc @pcmoritz @thomasdesr

Add secret_env_vars to runtime-env parameter of job submission

Philipp already talked to this user with another approach. I don’t think we are merging this PR. On Wed, May 15, 2024 at 03:40 Samuel Chan ***@***.***> wrote: > @rynewang...

Add secret_env_vars to runtime-env parameter of job submission

@prd-tuong-nguyen the recommended approach is to inject the secret via the mechanisms already established in your environment, e.g. [Use K8S Secrets to set env vars](https://kubernetes.io/docs/concepts/configuration/secret/), or to use secret managers...

Add secret_env_vars to runtime-env parameter of job submission

@pcmoritz can you share some advices on how to pass secrets to Ray tasks?

UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf8 in position 0: invalid start byte [<Ray component: tune }

Dask has same issue: https://github.com/dask/distributed/issues/5768

Ray + pynndescent (numba) compatibility issue

Root caused here: https://github.com/ray-project/ray/issues/45538 tldr: you can set this env var `RAY_TQDM_PATCH_PRINT=0` to workaround

[core][runtime_env] Allow full path in conda runtime env.

Doc updated

[core][runtime_env] Allow full path in conda runtime env.

@angelinalg : added a clause to the doc about how to specify `conda` runtime env. Previously you can set a env name like `"pytorch_p36"`, now you can also set an...

[core][runtime_env] Retry on read error in rt env agent client response read

Test timeout fixed - it turns out one previous test set some timeout-ing os env var and did not set back. Changed all such env vars to monkeypatch.