CTranslate2
CTranslate2 copied to clipboard
convert opennmt py on the fly and inference with model in memory
Convert the model (currently support opennmt-py) and save to the memory => inference without saving model.
Customizing the wrapper to save the memory used.
TODO: implementation for other converters