cube-studio icon indicating copy to clipboard operation
cube-studio copied to clipboard

Published 20 hours ago • verified publisher icon tencentmusic

能否提供如何部署triton-server的教程

Open wuqingzhou828 opened this issue 3 years ago • 3 comments

wuqingzhou828 avatar Jun 17 '22 06:06 wuqingzhou828

同求一个tf-serving的... ...

qianchen94 avatar Jun 23 '22 06:06 qianchen94

https://github.com/tencentmusic/cube-studio/wiki image

data-infra avatar Jun 29 '22 09:06 data-infra

https://github.com/tencentmusic/cube-studio/wiki image 部署成功之后：triton_client_url？model_name=？ image triton_client_url=？ model_name=？ try: triton_client = grpcclient.InferenceServerClient( url=triton_client_url, verbose=False, ssl=False) res = triton_client.is_model_ready(model_name=model_name) print("channel creation sucess .\n") print(res) except Exception as e: print("channel creation failed: " + str(e) + "\n")

wuqingzhou828 avatar Jul 04 '22 09:07 wuqingzhou828