PerroPastor
PerroPastor copied to clipboard
context/seq length?
not sure where to post this but is there a way to change the context or seq output length? it looks like its maxed out at 512 tokens but the models i have can do way way more. tried changed the seqlen in code but it made no difference