text-generation-inference
text-generation-inference copied to clipboard
Upgrade torch to 2.7 to support Blackwell GPUs
Feature request
Currently TGI supports torch 2.6 and does not work with Blackwell GPUs.
Motivation
I want to utilize Blackwell GPUs with TGI