langchain icon indicating copy to clipboard operation
langchain copied to clipboard

Add lazy iteration interface to document loaders

Open eyurtsev opened this issue 1 year ago • 0 comments

Adding a lazy iteration for document loaders.

Following the plan here: https://github.com/hwchase17/langchain/pull/2833

Keeping the load method as is for backwards compatibility. The load returns a materialized list of documents and downstream users may rely on that fact.

A new method that returns an iterable is introduced for handling lazy loading.

eyurtsev avatar Apr 27 '23 15:04 eyurtsev