litgpt icon indicating copy to clipboard operation
litgpt copied to clipboard
verified publisher icon Lightning-AI

NotImplementedError: max_seq_length 264 needs to be >= 857

Open xfengzs opened this issue 1 year ago • 1 comments

hi When I run sequentially.py, the following error is prompted. Increasing the number of GPUs also prompts this error.

raise NotImplementedError(f"max_seq_length {model.max_seq_length} needs to be >= {max_returned_tokens - 1}") NotImplementedError: max_seq_length 264 needs to be >= 857

how can i do , thanks

xfengzs avatar Jan 27 '24 11:01 xfengzs

Hi! I don't think this should happen. Can you share the exact command that you ran, the complete error stacktrace, and any changes you made to the repository?

carmocca avatar Jan 31 '24 19:01 carmocca