mediapipe
mediapipe copied to clipboard
How to split chunks sample_context.txt in rag example
I'm trying to split a large text and replace the sample_text.txt. But when the text is large although the token size is 256 I use a delimiter to split it, the method doesn't work as expected.
Is there a method documented on how to split the chunks on the sample text file ?