Rajesh Thallam

icon indicating a website link https://www.linkedin.com/in/rajeshthallam icon indicating an email [email protected]

icon company @GoogleCloudPlatform icon location San Francisco, CA icon location Machine Learning @ Google Cloud

Results 3 issues of Rajesh Thallam

Fix breaking changes due to langchain and chromadb dependencies

1 comment

Ref: https://github.com/chroma-core/chroma/issues/774 https://github.com/hwchase17/langchain/issues/7548

Export usage metrics externally

1 comment

Is it possible to export the usage metrics externally to GCS bucket to review utilization after the job is finished?

enhancement
help wanted

Serving large models with FT backend keeps Triton server crashing and restarting

We are trying to run Triton with FasterTransformer backend on a GKE cluster with A100 GPUs to serve models such as T5, UL2 which are hosted on Google Cloud Storage...