thepipe
thepipe copied to clipboard
Globbing based scraping
This is a version which adds globbing based file filtering within the directories you scrape. The changes in this are already included in the forthcoming yt-dlp pull request as well. This also implements a weakref system in order to deal with certain files possibly not being correctly made available to python as processing finishes and refs are terminated which could cause crashes
This should actually include a small change I made in a branch built off this, it currently supports only 1 filter but should support n many. Please see: https://github.com/emcf/thepipe/pull/27/commits/3f1dc4449bcd7d35bfe9aa3c8aa4adca190ef137