MLDatasets.jl icon indicating copy to clipboard operation
MLDatasets.jl copied to clipboard

first attempt at artifacts

Open CarloLucibello opened this issue 4 years ago • 1 comments

The download is not lazy at the moment, I don't understand how to lazily download multiple files.

Even if that is fixed, I don't see a clear advantage over current DataDeps implementation so not sure this is worth doing

CarloLucibello avatar Mar 30 '21 08:03 CarloLucibello

On clear advantage: having this as artifact using Artifacts means it does not download directly, but it goes through the julia package server. When someone is using firewall and package server is whitelisted there, data downloaded through Artifacts go through that, so that's good, but using datadeps means it's downloading data directly, not going through the package server. Multiple files can be downloaded by having it as multiple artifacts, see e.g. here: https://github.com/JuliaTime/TimeZones.jl/blob/master/Artifacts.toml

racinmat avatar Oct 21 '21 12:10 racinmat