text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard
verified publisher icon huggingface

Upgrade torch to 2.7 to support Blackwell GPUs

Open CrashTimeV opened this issue 8 months ago • 0 comments

Feature request

Currently TGI supports torch 2.6 and does not work with Blackwell GPUs.

Motivation

I want to utilize Blackwell GPUs with TGI

Your contribution

CrashTimeV avatar May 05 '25 15:05 CrashTimeV