Robby-chatbot icon indicating copy to clipboard operation
Robby-chatbot copied to clipboard

Published 20 hours ago • verified publisher icon yvann-ba

Exceeds token limit

Open yudataguy opened this issue 1 year ago • 0 comments

I tried a non-english pdf, and the token exceeds the limitation. I think it probably due to how sentence splitter works, since the period is not .

yudataguy avatar May 08 '23 07:05 yudataguy