jan icon indicating copy to clipboard operation
jan copied to clipboard

Published 20 hours ago • verified publisher icon janhq

epic: Jan <> NVIDIA Triton & TensorRT LLM

Open hiro-v opened this issue 1 year ago • 0 comments

  • [ ] Step by Step documentation for Jan <> Triton inference server with TensorRT-LLM - 1 day
  • [ ] Updated code in triton-tensorrt-llm extension to support - 1 day

hiro-v avatar Jan 29 '24 02:01 hiro-v