graphstorm
graphstorm copied to clipboard
[GSProcessing] Handle `*` wildcards in filenames
Issue #, if available:
Fixes https://github.com/awslabs/graphstorm/issues/1107
Description of changes:
- Add handling for
*in file paths, for local and S3 input in GSProcessing - For local we glob files, for S3 we first list all files under prefix, then match file pattern
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.