PerroPastor icon indicating copy to clipboard operation
PerroPastor copied to clipboard

context/seq length?

Open Himb000 opened this issue 1 year ago • 1 comments

not sure where to post this but is there a way to change the context or seq output length? it looks like its maxed out at 512 tokens but the models i have can do way way more. tried changed the seqlen in code but it made no difference

Himb000 avatar Oct 24 '23 21:10 Himb000