datumaro icon indicating copy to clipboard operation
datumaro copied to clipboard

Support remote data sources

Open zhiltsov-max opened this issue 3 years ago • 0 comments

Clouds and other kinds of remotes, which include s3, Azure, Google Drive, NFS & CIFS file shares, Git, Git-lfs, etc. are common places for storing large datasets. Support of such storages can be very useful when working with datasets.

Requirements:

  • An ability to import remotely placed data as a data source into a project
    • Read-only mode
    • Synchronization (version checks)
    • Downloading
    • Local caching
    • Writing, pushing of updates

zhiltsov-max avatar Mar 04 '21 10:03 zhiltsov-max