santree

Results 13 comments of santree

In simple terms, the work of the Splitter can be summarized in the following steps: 1. Perform text segmentation, retaining the separating symbols if the `keepSeperator` flag is set, such...

However, based on the following reasons, I believe this issue may not require modification: 1. Leading and trailing whitespace characters do not affect the semantics of the text split out....

```typescript const data = fs.readFileSync(profileFilePath); const textSplitterChat = new RecursiveCharacterTextSplitter({ chunkSize: 1000, chunkOverlap: 200, separators: ["\n"], }); const docs = await textSplitterChat.createDocuments( profile.toString() ); ``` Maybe the `data` should be...