EnergonAI icon indicating copy to clipboard operation
EnergonAI copied to clipboard

Published 20 hours ago • verified publisher icon hpcaitech

OPT inference

Open Joanna-0421 opened this issue 1 year ago • 2 comments

hello, I want to just inference of pre-trained model in the terminal, but I don't want to run a HTTP server. How could I do that?

Joanna-0421 avatar Feb 28 '23 12:02 Joanna-0421