MLServer
MLServer copied to clipboard
Merge our fork with the opensource MLServer. All changes are to the huggingface runtime.
trafficstars
Fix an issue where the model is loaded twice, causing double memory usage. And, allow the device argument to accept strings.