Robert Shaw

icon company @redhat icon location Boston icon location vllm and llm-d

Results 44 issues of Robert Shaw

Rs/feature/metrics

10 comment

### Summary This PR does three things: A) Addresses open feature request (#1870) by refactoring and extending initial implementation of metrics (#1890) to: * Handle more complex metrics such as...

Building from scratch in recommended Docker container does not work

FYI the [recommended path](https://docs.vllm.ai/en/latest/getting_started/installation.html#build-from-source) to install from source (using the following container: `nvcr.io/nvidia/pytorch:23.10-py3`) is failing. I managed to get it built with `nvidia/cuda:12.1.0-base-ubuntu22.04` instead (after installing `python3-dev` in the container)....

Mlserver example

Rs/docs update

Rs/logging example

* Simple Example Connecting DeepSparse Logging To Prometheus

added roboflow example

1 comment

Rs/example/deepsparse milvus

1 comment

Had the wrong readme in here

Update sparse-transfer-learning.md

fixes for new install pathway

[documentation] Recipes User Guide

Rs/docs update

1 comment