JoJoLev

Same GPU build, same files, but got the error: The engine plan file is generated on an incompatible device, expecting compute 9.0 got compute 8.9, please rebuild.

1

### System Info Running an an H200, engine was built on an H200 as outlined by the config.json file. When deploying to H200, I received this error: The engine plan...

Does NVIDIA Triton support the new TensorRt-LLM PyTorch workflow?

1

TensorRT-LLM has shifted to a torch backend. Is this easily integrated with Triton? What is the plan for support for this?