server icon indicating copy to clipboard operation
server copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

how to deploy BERT

Open chenchunhui97 opened this issue 1 year ago • 1 comments

I want to deploy MaCBert but I cannot find some helpful blogs, do you have instructions about deployment of this model?

chenchunhui97 avatar Aug 05 '24 10:08 chenchunhui97

Hi @chenchunhui97, this example is pretty old, but may work: https://github.com/NVIDIA/DeepLearningExamples/blob/master/PyTorch/LanguageModeling/BERT/triton/README.md

rmccorm4 avatar Aug 06 '24 19:08 rmccorm4