MLDatasets.jl icon indicating copy to clipboard operation
MLDatasets.jl copied to clipboard

too much printing for some datasets

Open CarloLucibello opened this issue 3 years ago • 4 comments

There is a lot of output when testing OGBDataset and SMSCollection, see this CI run. Maybe we can suppress these outputs although I'm not sure why we don't see this verbosity with other datasets

CarloLucibello avatar Jul 02 '22 03:07 CarloLucibello

OGBDataset downloads zipped CSVs. All the verbosity is due to these zipped CSVs.

Dsantra92 avatar Jul 02 '22 19:07 Dsantra92

Is there something like a verbose=false argument we can pass?

CarloLucibello avatar Jul 03 '22 08:07 CarloLucibello

Is there something like a verbose=false argument we can pass?

DataDeps.unpack does not accept extra keyword arguments. Moreover, 7z does not give the option for silent extraction.

If we design our own unpack method, we need to pipe the output to null in UNIX systems. Don't know how the null concept works in Windows.

Dsantra92 avatar Jul 04 '22 07:07 Dsantra92

Awaiting https://github.com/oxinabox/DataDeps.jl/pull/143

Dsantra92 avatar Sep 10 '22 06:09 Dsantra92