MLServer icon indicating copy to clipboard operation
MLServer copied to clipboard

Merge our fork with the opensource MLServer. All changes are to the huggingface runtime.

Open NickMcKillip opened this issue 1 year ago • 1 comments
trafficstars

Fix an issue where the model is loaded twice, causing double memory usage. And, allow the device argument to accept strings.

NickMcKillip avatar Mar 02 '24 00:03 NickMcKillip

CLA assistant check
All committers have signed the CLA.

CLAassistant avatar May 22 '24 17:05 CLAassistant