WizardLM
WizardLM copied to clipboard
Wizard Coder 15B: Max Input Token size and output token size
Hi, For Wizard Coder 15B I would like to understand:
- What is the maximum input token size for the wizard coder 15B?
- Similarly what is the max output token size?
- In cases where want to make use of this model to say review code across multiple files which might be dependent (one file calling function from another), how to tokenize such code before asking WizardCoder to summarise it as it may exceed the token size limit?