CodeGen icon indicating copy to clipboard operation
CodeGen copied to clipboard

Pretrain modell

Open Elvares opened this issue 2 years ago • 1 comments

Hi, I want to train model for translation pascal2java. I have small datasets about 2 Gb of pascal and 2 Gb of java. I train model mlm and then train transcoder model but translation doesn't work. When I try to translate pascal2java I got same function of pascal or bad translation of java. It can be problem with small dataset or overfittig?

Elvares avatar Jun 15 '22 07:06 Elvares

also when I train mlm model and then try to use it for transcoder model I got image Is it problem?

Elvares avatar Jun 16 '22 14:06 Elvares