CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard

Published 20 hours ago • verified publisher icon OpenNMT

Can Tensor2Tensor Export to Ctranslate2 Format?

Open scotfang opened this issue 3 years ago • 4 comments

Hi,

Wasn't able to find great information on this, but do you know if https://github.com/tensorflow/tensor2tensor#translation supports exporting to Ctranslate2 format?

Thanks! --Scot

scotfang avatar Sep 09 '21 23:09 scotfang

Hi,

Currently there is no converter for Tensor2Tensor, but it should not be too complicated to add one. Contributions are welcome.

guillaumekln avatar Sep 10 '21 07:09 guillaumekln

I’m really interested to this as well…

smcdufff avatar Dec 25 '21 10:12 smcdufff

Hello, What's required to support tensor2tensor? I can work out the code details

amrnablus avatar Jan 02 '22 21:01 amrnablus

A converter should be added to load and register weights from a T2T checkpoint. You can explore how existing converters are defined: https://github.com/OpenNMT/CTranslate2/tree/master/python/ctranslate2/converters

guillaumekln avatar Jan 03 '22 08:01 guillaumekln

The tensor2tensor repository is now archived so we are not adding an "official" converter.

However, it is still possible to write your own converter using the existing ones as examples.

guillaumekln avatar Jul 26 '23 13:07 guillaumekln