griptape icon indicating copy to clipboard operation
griptape copied to clipboard

Published 20 hours ago • verified publisher icon griptape-ai

Chunking with overlap

Open Ioannis-Pikoulis opened this issue 1 year ago • 1 comments

Hello.

I would like to know whether chunking with overlap is currently possible using the current implementations within chunkers and if not, is it going to be featured in the near future. If this is not the case, LangChain already has provided this functionality.

Ioannis-Pikoulis avatar Oct 14 '23 08:10 Ioannis-Pikoulis

We'll investigate the relative performance with and without overlap.

derekpai avatar Oct 24 '23 20:10 derekpai