jay
jay
@colin-ho Please take a look at this PR when you have time. Thank you very much.
@srilman Please help review this PR when you have time.
> @Jay-ju can you fix merge conflicts? @colin-ho bump @ohbh @colin-ho * This PR is ready for review. Please take a look when you have time. * It's unclear why...
> Couple more things to note: > > 1. This functionality will only work on ray runner AND if the user specifies concurrency. We should add documentation about this as...
# Prerequisites Before you begin, please ensure you have met the following conditions: - Ray Cluster: A multi-worker group has been created on Ray and identified with labels. For example,...
@colin-ho @kevinzwang Please take a look at this PR when you have time. Thank you very much.
@colin-ho Could you please take another look?
@colin-ho If I want 4 concurrent downloads and 10 concurrent embeddings, how can I do this?
Also, how can I determine whether it is caused by embedding or download that results in out-of-memory (OOM)?
``` 934] task_manager.cc:1103: Task attempt cf90ddcc5053e2b0ffffffffffffffffffffffff1d000000 failed with error OUT_OF_MEMORY Fail immediately? 0, status RpcError: RPC Error message: Socket closed; RPC Error details: , error info error_message: "Task was killed...