MLServer
MLServer copied to clipboard
Support Triton repository layout
Triton enforces a specific repository layout, which makes it easier to find models by name. We should consider adding an alternative repository implementation that follows Triton's layout - which could speed up model load and list (particularly important for large MMS workloads).