mesh icon indicating copy to clipboard operation
mesh copied to clipboard

Mesh-tf model conversion to onnx?

Open b-analyst opened this issue 3 years ago • 2 comments

Hi, I've been trying to deploy an mtf model to the NVIDIA Triton Inference Server by converting the SavedModel (output of model.export()) to an onnx file with no luck. I've been receiving several errors, but the main recurring one seems to be regarding the lack of a registered SentencePieceOps. Is there a tutorial for an mtf model deployment available anywhere?

b-analyst avatar Nov 14 '21 04:11 b-analyst

hi @b-analyst , I am just wondering that are you working on image models like u-net or language models like Bert? thx!

WingsOfPanda avatar Feb 19 '22 10:02 WingsOfPanda

Hi! Thank you for replying. I am using a language model - T5 to be specific. I've been using the mtf model implementation from Google-research's GitHub. I managed to convert it to a Pytorch model, and I've been successful at converting to onnx.

b-analyst avatar Feb 19 '22 21:02 b-analyst