ROCm icon indicating copy to clipboard operation
ROCm copied to clipboard

[tf-serving] Is it possible to run tf-serving with AMD GPUs/ROCm?

Open tgcandido opened this issue 4 years ago • 2 comments

Greetings,

I have an application that uses the tf-serving docker container with the nvidia-docker container to enable GPU inference.

Is it possible to run the tf-serving docker container with AMD GPU/ROCm for GPU inference?

Regards

tgcandido avatar Dec 29 '21 13:12 tgcandido

Thanks @tgcandido for reaching out. Let me gather some information on this and will update you asap. Thank you.

ROCmSupport avatar Jan 28 '22 11:01 ROCmSupport

@ROCmSupport What's your latest on TF Serving support on AMD GPUs?

asamadiya avatar Oct 05 '22 18:10 asamadiya

@ROCmSupport Do you have any update on this ticket? Thanks!

ppanchad-amd avatar May 07 '24 20:05 ppanchad-amd

@tgcandido Sorry for the lack of response. Do you still assistance with this ticket? Thanks!

ppanchad-amd avatar May 23 '24 16:05 ppanchad-amd

@tgcandido Closing ticket. Please re-open if you still need assistance with this ticket. Thanks!

ppanchad-amd avatar Jun 17 '24 20:06 ppanchad-amd