datumaro
datumaro copied to clipboard
Support remote data sources
Clouds and other kinds of remotes, which include s3, Azure, Google Drive, NFS & CIFS file shares, Git, Git-lfs, etc. are common places for storing large datasets. Support of such storages can be very useful when working with datasets.
Requirements:
- An ability to import remotely placed data as a data source into a project
- Read-only mode
- Synchronization (version checks)
- Downloading
- Local caching
- Writing, pushing of updates