stanford_alpaca icon indicating copy to clipboard operation
stanford_alpaca copied to clipboard

Token input limit only 500?

Open teknium1 opened this issue 2 years ago • 0 comments

When I prompted Alpaca with ~800 tokens I got this error: Token indices sequence length is longer than the specified maximum sequence length for this model (521 > 512). Running this sequence through the model will result in indexing errors

Is this alpaca/llama as a whole, or my huggingface transformers, or what?

teknium1 avatar Mar 23 '23 05:03 teknium1