juliaup icon indicating copy to clipboard operation
juliaup copied to clipboard

Installation is 'slow'

Open maleadt opened this issue 1 year ago • 2 comments

Now that there's support for nightlies, I see juliaup downloading updates much more than before, which has led me to realize that the process is relatively slow:

❯ time juliaup add nightly
Installing Julia latest-linux-x86_64
juliaup add nightly  2.90s user 2.36s system 25% cpu 20.490 total

vs.

❯ time wget https://julialangnightlies-s3.julialang.org/bin/linux/x86_64/julia-latest-linux-x86_64.tar.gz -O - | tar -xzf - -C $HOME
2024-02-27 13:59:40 (25.9 MB/s) - written to stdout [245088202/245088202]

wget  -O -  0.72s user 0.21s system 10% cpu 9.214 total
tar -xzf - -C $HOME  4.70s user 2.09s system 73% cpu 9.218 total

This is of course a minor issue, 20 seconds isn't terrible, but it's curious that it's twice as slow as wget + tar.

I'm using the official released version of juliaup. When working on the nightly support, I was using a debug build which was even slower, so maybe this is simply a matter of missing compiler optimizations?

maleadt avatar Feb 27 '24 13:02 maleadt

Here is some sort of profile:

image

Maybe https://github.com/JuliaLang/juliaup/blob/5967916d85ed2935e8c35e3818830b9db5daa191/src/operations.rs#L35-L51 is slow?

KristofferC avatar Feb 27 '24 13:02 KristofferC

Interesting; I was just collecting flamegraphs too:

juliaup wget_tar_gzip

Here it seems like much more time is spent writing data.

maleadt avatar Feb 27 '24 13:02 maleadt