llm-foundry icon indicating copy to clipboard operation
llm-foundry copied to clipboard

Published 20 hours ago • verified publisher icon mosaicml

code example for the onnx model

Open therealadityashankar opened this issue 2 years ago • 0 comments

Hi Mosaicml folks,

this is because of a lack of knowledge on my end, and I apologize for this, I'd be extremely greatful if you could give me example code on how to use the onnx model generated by https://github.com/mosaicml/llm-foundry/blob/main/scripts/inference/convert_hf_to_onnx.py

therealadityashankar avatar May 15 '23 08:05 therealadityashankar