CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard

convert opennmt py on the fly and inference with model in memory

Open minhthuc2502 opened this issue 7 months ago • 0 comments

Convert the model (currently support opennmt-py) and save to the memory => inference without saving model.

Customizing the wrapper to save the memory used.

TODO: implementation for other converters

minhthuc2502 avatar Dec 06 '23 16:12 minhthuc2502