nos icon indicating copy to clipboard operation
nos copied to clipboard

Published 20 hours ago • verified publisher icon autonomi-ai

Subclass InferenceServiceRuntime under DockerRuntime

Open outtanames opened this issue 1 year ago • 0 comments

Reduce bloat, move init, ready, id etc into the subclass. Right now we just have an inference runtime, but future releases might include runtimes for benchmarking, compilation etc.

outtanames avatar May 24 '23 00:05 outtanames