scvi-tools
scvi-tools copied to clipboard
OpenVINO backend
trafficstars
I would like to contribute an OpenVINO backend (allows to speed up the runtime of pretrained models) for the models in this repository.
Now I have a script, which converts VAE model to OpenVINO representation. Could you please share tests or demo for VAE model so I can compare accuracy and execution time of the original and OpenVINO model?
Demo is here. Would you be able to provide some details on the advantages of OpenVINO for this project? We are not typically in the scenario of serving pre-trained models. Thanks!
Closing as this is out of scope for this package.