langchain icon indicating copy to clipboard operation
langchain copied to clipboard

Published 20 hours ago • verified publisher icon langchain-ai

Break the dependency between langchain-common and langchain

Open pprados opened this issue 1 year ago • 1 comments

** Description** To break the dependency between langchain-common and langchain, I propose a new load_and_transform() method.

BaseLoader currently offers the load_and_split() method, which expects a TextSplitter. The TextSplitter class is only present in langchain, and not in langchain-core or langchain-common. This creates a link between langchain-common and langchain for all loaders. It is possible to break this link by using transformers. There is one limitation: it is no longer possible to suggest using RecursiveCharacterTextSplitter by default (a class from langchain).

pprados avatar Jan 24 '24 09:01 pprados

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
langchain ⬜️ Ignored (Inspect) Visit Preview Jan 29, 2024 8:54am

vercel[bot] avatar Jan 24 '24 09:01 vercel[bot]