deep-learning-containers icon indicating copy to clipboard operation
deep-learning-containers copied to clipboard

Published 20 hours ago • verified publisher icon aws

[HuggingFace-Feature request] Support TGI 2 3.1

Open xuan1905 opened this issue 4 months ago • 0 comments

TGI has released the 2.3.1 version. This is important as it supports inference with Llama3.2-vision. Please consider upgrade the image so we can use the model on Sagemaker.

xuan1905 avatar Oct 08 '24 02:10 xuan1905