langchainrb icon indicating copy to clipboard operation
langchainrb copied to clipboard
verified publisher icon patterns-ai-core

Support more loaders

Open drale2k opened this issue 2 years ago • 2 comments

It would be great to support more content loaders, such as:

  • Youtube video transcripts
  • Direct Website crawling and via Sitemaps
  • Google Drive folders

I stumbled upon embedchain which looks really nice. I think it can act as a great reference

drale2k avatar Sep 25 '23 23:09 drale2k

@drale2k I'm currently overhauling all of the loaders and chunkers and will keep you updated.

andreibondarev avatar Sep 30 '23 18:09 andreibondarev

Could you please include Shell and Filesystem too?

Although can't Shell just use the default shell? Personally I use OpenBSD's hardened ksh, but for my scripts I prefer zsh as opposed to the overcomplicated and advisory prone bash (check out this mess followed by a cleanup).

basicfeatures avatar Oct 05 '23 20:10 basicfeatures