llama_index
llama_index copied to clipboard
Way to exclude directories and files using SimpleDirectoryReader
Sometimes directories contain both relevant and irrelevant subdirectories and/or files, it would be nice to have a keyword argument for excluding them, perhaps even with some matching syntax, e.g.
documents = SimpleDirectoryReader('...', recursive=True, exclude=["*/misc/*, "note.txt"])
nice feature