synthesis task

[TracyTd]

Hello! After reviewing the codebase, I've noticed that it seems to focus solely on code translation tasks. I was wondering if there's a way to adjust the parameters to enable program synthesis tasks where the source language is English text. In the rl_run.py script, the dir_dict dictionary contains mappings for programming languages, but I couldn't find options for natural languages like English. I would greatly appreciate your guidance on this matter. Thank you very much for your assistance!

[Cheungki]

Same question. Besides, the codebase only provided feedback from the compiler instead of the unit tests.