CodeGen

CodeGen copied to clipboard

Pretrain modell

1

Hi, I want to train model for translation pascal2java. I have small datasets about 2 Gb of pascal and 2 Gb of java. I train model mlm and then train...

Elvares

UncompletedJobError: No output/error stream produced

1

I am running the CodeGen using the test repository (https://github.com/facebookresearch/CodeGen/tree/main/data/test_dataset) for obfuscation mode `run codegen_sources/preprocessing/preprocess.py data/python_test --mode obfuscation --local True --local_parallelism 4 --langs python --train_splits 1 --tokenization_timeout 400 --bpe_timeout 220...

sushantkumar007007

UncompletedJobError: Job 195 (task: 0) with path /home/sushantk/anaconda3/codeGen/data/test_dataset/log/195_0_result.pkl has not produced any output (state: FINISHED) No output/error stream produced ! Check: /home/sushantk/anaconda3/codeGen/data/test_dataset/log/195_0_log.out

1

I am trying to run the preprocessing.py file and getting this unknow error. Can you tell me how to resolve this. ```` run codegen_sources/preprocessing/preprocess.py data/test_dataset --mode obfuscation --langs python --mode...

sushantkumar007007

Problem with unrecognized argument

1

When I run the CodeGen, the preprocessing.py it is asking for various arguments and when I pass those argument its showing unrecognized arguments. Below are my codes. %run codegen_sources/preprocessing/preprocess data/test_dataset...

sushantkumar007007

Evaluate Transcoder_model_1 on CodeXGlue benchmark

3

Hi, I am trying to follow the instruction in dobf.md to evaluate Transcoder_model_1.pth on Clone detection. After I run following command, the error related to reloading the model appears. I...

LANCHERBA

Failed to generate create self-training dataset per transcoder-st doc

1

Hi, When I was following the instructions from https://github.com/facebookresearch/CodeGen/blob/main/docs/TransCoder-ST.md to create self-training dataset. The create_self_training_dataset.sh failed with the Assertion Error: ######### Creating Tests ########## Traceback (most recent call last): File...

weidotwisc

Ablation on data size

2

Hi, appreciate the amazing work in unsupervised code translation! I wonder if you have done ablation study on the training data size of TransCoder? Since the unsupervised model needs way...

yssjtu

Can this be used to translate between SQL dialects?

1

I am working on a project where I have to convert Teradata SQL queries to redshift queries. This has to be then generalized for other dialects to like for eg...

rohankavari

Could CodeGen run on Windows?

2

I try to run CodeGen on Windows. But error occurred when I install fastBPE with pip3.I donot know how to solve.Could anyone help me? The error log list here: Collecting...

hsiang-lee

Question for validation and test sets

1

Hi, as the paper "Unsupervised Translation of programming languages" mentioned, there are 852 parallel functions. So I checked the data in this repo [fold](https://github.com/facebookresearch/CodeGen/tree/main/data/transcoder_evaluation_gfg) and found (each file contain one...

ghost