Token indices sequence length is longer than the specified maximum sequence length for this model

[bullybutcher]

Converting PDF to txt file. Successfully converted PDF to txt. Total Number of Lines: 13596 No chapters in book! Writing entire book! Done writing! pdf_fileChapterAll.txt Summarising: pdf_fileChapterAll.txt Token indices sequence length is longer than the specified maximum sequence length for this model (536 > 512). Running this sequence through the model will result in indexing errors

[saarthdeshpande]

@shanayghag can you please look into this