notebooks icon indicating copy to clipboard operation
notebooks copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

SageMaker TGI DLC ENV vars

Open austinmw opened this issue 2 years ago • 0 comments
trafficstars

Hi, is there documentation for the list of ENV vars available when deploying the TGI DLC container in SageMaker? For example, any others besides these? HF_MODEL_ID, SM_NUM_GPUS, HF_MODEL_QUANTIZE

austinmw avatar Jun 01 '23 16:06 austinmw