fms-fsdp icon indicating copy to clipboard operation
fms-fsdp copied to clipboard

Published 20 hours ago • verified publisher icon foundation-model-stack

Support nested folders for datasets

Open thinkahead opened this issue 1 year ago • 1 comments

The current code only looks for files in the dataset folder. When the dataset has additional nested folders, these arrow files are not seen

thinkahead avatar Jun 05 '24 14:06 thinkahead

Pull request https://github.com/foundation-model-stack/fms-fsdp/pull/90

thinkahead avatar Jun 05 '24 14:06 thinkahead

Closing with #107

daviswer avatar Oct 10 '24 19:10 daviswer