text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard
verified publisher icon huggingface

Feat/trtllm cancellation dev container

Open Hugoch opened this issue 1 year ago • 1 comments

What does this PR do?

Add DevContainer to build TRTLLM backend.

Hugoch avatar Dec 02 '24 21:12 Hugoch

@Narsil yes, the original PR #2791 has significant file movements to simplify the overall structure for TRTLLM.

This specific PR depends on the #2791 and changes are pretty much concentrated into the .devcontainer folder to create a reproducible dev environment.

We are missing the optimum-nvidia release to be able to merge - CI/CD will follow, on it rn 😊

mfuntowicz avatar Dec 11 '24 09:12 mfuntowicz