Jeremy Lewi
Jeremy Lewi
I'm hitting the same issue. @mattt to answer your questions 1. I'm deleting the model via API 2. The deleted model no longer shows up in the UI 3. Issuing...
I see the [docs](https://github.com/NVIDIA/TensorRT-LLM/blob/5ddb6bf218ed16a2dcf0058f20c59a247e180fd2/docs/source/installation/build-from-source-linux.md#linking-with-the-tensorrt-llm-c-runtime) describe the `cpp_only` option more. However, I'm still confused about 1. When are the python bindings required? Are they only required when building LLM engines? Or...
I was able to build the tensorrtllm_backend by following the [directions for building it in a container](https://github.com/triton-inference-server/tensorrtllm_backend/tree/main?tab=readme-ov-file#option-2-build-via-docker). I believe that invokes the same [build_wheel.py](https://github.com/NVIDIA/TensorRT-LLM/blob/5fa9436e17c2f9aeace070f49aa645d2577f676b/scripts/build_wheel.py) I was running above. Which would...
So I think the problem is that I'm missing `libcuda.so.1`. Anyone know where that library comes from? Is it the user space driver? This [dated post](https://forums.developer.nvidia.com/t/cuda-compatibility-packages/66343) implies the cuda compatibility...
I resolved this by obtaining the CUDA compatibility libs from the driver https://developer.download.nvidia.com/compute/cuda/redist/nvidia_driver/linux-x86_64/nvidia_driver-linux-x86_64-545.23.08-archive.tar.xz
I'm not sure why golang is failing with the following error ``` run golangci-lint Running [/home/runner/golangci-lint-1.63.2-linux-amd64/golangci-lint run --out-format=github-actions] in [] ... Error: Comment should end in a period (godot) ```...
Out of the box integration with metadata would be awesome.
A couple things to be aware of. It looks protobuf-es just released version 2.0 which breaks backwards compatibility. (I think this is to support protobuf editions). This introduces a dependency...
I've been using 3.11.0 https://github.com/stateful/vscode-runme/releases/tag/3.11.1-edge.0 since it was released with no observed issues. Just installed https://github.com/stateful/vscode-runme/releases/tag/3.11.1-edge.1
Will do. FWIW, I recognize this is an unhelpful bug report and don't know how to reproduce it. I think its reasonable to close it as unactionable. I mainly wanted...