DataSets.jl
DataSets.jl copied to clipboard
Large dataset examples
It'd be nice to have a practical list of examples of scientific data workflows as inspiration for DataSets.jl.
Here's some examples I came across on discourse:
- Reading and chunk-based parallel processing of NetCDF files: https://discourse.julialang.org/t/help-me-beat-my-pythonist-friends-code-speeding-up-data-reading-with-simple-reduction-from-netcdf-file/76457/31
- Downloading protein data and untarring it on the fly: https://discourse.julialang.org/t/how-to-plumb-together-download-uncompress-untar-without-writing-full-downloaded-file/76668/6