Unstructured Document Loader - Maximum call stack size exceeded

[keithknott26]

Describe the bug When processing a large folder of .html documents with the Unstructured.io document loader, I observed an error message when trying to upsert documents: RangeError: Maximum call stack size exceeded.

2023-12-18 20:48:12 [ERROR]: Maximum call stack size exceeded RangeError: Maximum call stack size exceeded at UnstructuredDirectoryLoader.load (/opt/homebrew/lib/node_modules/flowise/node_modules/langchain/dist/document_loaders/fs/directory.cjs:97:31) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async UnstructuredFolder_DocumentLoaders.init (/opt/homebrew/lib/node_modules/flowise/node_modules/flowise-components/dist/nodes/documentloaders/Unstructured/UnstructuredFolder.js:115:22) at async buildLangchain (/opt/homebrew/lib/node_modules/flowise/dist/utils/index.js:245:54) at async App.buildChatflow (/opt/homebrew/lib/node_modules/flowise/dist/index.js:1250:40) at async /opt/homebrew/lib/node_modules/flowise/dist/index.js:938:13 2023-12-18 20:48:12 [ERROR]: [server]: Error: RangeError: Maximum call stack size exceeded Error: RangeError: Maximum call stack size exceeded at buildLangchain (/opt/homebrew/lib/node_modules/flowise/dist/utils/index.js:258:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async App.buildChatflow (/opt/homebrew/lib/node_modules/flowise/dist/index.js:1250:40) at async /opt/homebrew/lib/node_modules/flowise/dist/index.js:938:13

To Reproduce Point the unstructured.io folder path at .html files in a directory Save the flow Upsert the documents The error appears

Expected behavior A clear and concise description of what you expected to happen.

Screenshots

Flow If applicable, add exported flow in order to help replicating the problem.

Setup docker npx flowise start macOS Chrome browser

Additional context Add any other context about the problem here.

[kweripx]

any updates on this? im having the same issue but with csv file