MLServer
MLServer copied to clipboard
Investigate Intel accelerator for scikit-learn models
trafficstars
Intel has an accelerator (both for training and inference) of scikit-learn models: https://github.com/intel/scikit-learn-intelex. It would be interesting to see if we could use this in our scikit-learn runtime. It's unclear at the moment if it's possible to take a stock scikit-learn model but then accelerate it using this library at inference time.