More examples about marian

[Aalivexy]

I'm a beginner in AI and I'm having some trouble trying to use the models from firefox-translations-models on candle.

The examples at candle-examples/examples/marian-mt are great, but a lot of things are hardcoded (e.g. marian::Config::opus_mt_fr_en) and I don't know how to use it.

What I have now (just as an example):

model.enzh.intgemm.alphas.bin
lex.50.50.enzh.s2t.bin
trgvocab.enzh.spm
srcvocab.enzh.spm

I'm wondering how I should load these models into candle to use them. I can currently get these models up and running with translateLocally, following its tutorial It would be great to be able to use Firefox's translation models in candle, I think it would improve candle's usage a bit!

[greenrazer]

I'm not sure about the firefox model, but in the meantime. I added some new language pairs to the marian-mt example in this PR(https://github.com/huggingface/candle/pull/2860).

[Aalivexy]

I'm not sure about the firefox model, but in the meantime. I added some new language pairs to the marian-mt example in this PR(#2860).

I encountered some problems when trying to convert it to HF format/Pytorch, see https://github.com/mozilla/translations/issues/804.

Maybe it’s the problem of the student model line Transformer-RNN structure + int8shiftAlphaAll mode? Does candle support it?

Awesome work, btw