CodeGen icon indicating copy to clipboard operation
CodeGen copied to clipboard

Limit of code generation

Open AndreasMeyerSFDC opened this issue 1 year ago • 1 comments

The settings for "model.generate" in the demo script are limiting the amount of code which is generated. The current settings:

model.generate(**inputs, max_length=128)

isn't able to create a function with more than 10 lines of code. Setting a max_length of 32k or higher will increase the calc time in an exponential manner. Is there a way to just return the whole code without setting max_length? The default value for max_length is 20 ... that will only return 1 or 2 lines of code. If the model even usable for functions which are bigger than 20 - 30 lines of code?

AndreasMeyerSFDC avatar Jul 04 '23 16:07 AndreasMeyerSFDC

I also encountered this problem, how did you solve it?

peppa-xyz avatar Jul 25 '23 14:07 peppa-xyz