ClimateMachine.jl icon indicating copy to clipboard operation
ClimateMachine.jl copied to clipboard

Upgrade to Julia 1.6 šŸš€

Open charleskawczynski opened this issue 4 years ago • 42 comments

Description

Upgrade to Julia 1.6 šŸš€. This was all I needed to run the test suite locally!

  • [x] Code follows the style guidelines OR N/A.
  • [x] Unit tests are included OR N/A.
  • [x] Code is exercised in an integration test OR N/A.
  • [x] Documentation has been added/updated OR N/A.

charleskawczynski avatar Mar 25 '21 21:03 charleskawczynski

Looks like there is an issue with the binary NetCDF JLL? I think we are still waiting on getting 1.6 installed on the cluster but this is promising!

jakebolewski avatar Mar 25 '21 21:03 jakebolewski

Looks like there is an issue with the binary NetCDF JLL? I think we are still waiting on getting 1.6 installed on the cluster but this is promising!

Yeah! Ah, good point, I didn't try the docs.

charleskawczynski avatar Mar 25 '21 21:03 charleskawczynski

bors try

charleskawczynski avatar Mar 26 '21 01:03 charleskawczynski

try

Build failed:

bors[bot] avatar Mar 26 '21 01:03 bors[bot]

ModuleCmd_Load.c(213):ERROR:105: Unable to locate a modulefile for 'julia/1.6'

vchuravy avatar Mar 26 '21 01:03 vchuravy

I’m guessing that is not the right module name (try Julia/1.6.0)

On Thu, Mar 25, 2021 at 7:52 PM Valentin Churavy @.***> wrote:

ModuleCmd_Load.c(213):ERROR:105: Unable to locate a modulefile for 'julia/1.6'

— You are receiving this because your review was requested. Reply to this email directly, view it on GitHub https://github.com/CliMA/ClimateMachine.jl/pull/2146#issuecomment-807871988, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAI2VJXIPXE2HPFDA54BSN3TFPSEZANCNFSM4Z2D3INQ .

jakebolewski avatar Mar 26 '21 03:03 jakebolewski

bors try

charleskawczynski avatar Mar 26 '21 13:03 charleskawczynski

try

Build failed:

bors[bot] avatar Mar 26 '21 13:03 bors[bot]

It looks like there is an issue combining StaticArrays.ll with StaticNumbers.jl in 1.6+, ex: https://github.com/CliMA/ClimateMachine.jl/blob/master/src/Numerics/DGMethods/remainder.jl#L431

Is StaticNumbers necessary if 1.6 has improved constant propagation when used with KA?

jakebolewski avatar Mar 26 '21 16:03 jakebolewski

I'll try removing StaticNumbers, but idk the best way to ensure that the performance hasn't changed.

charleskawczynski avatar Mar 26 '21 16:03 charleskawczynski

Also getting a segfault: https://buildkite.com/clima/climatemachine-ci/builds/1563#4746f8ba-e1c2-4628-a860-fddb19314844/95-107

jakebolewski avatar Mar 26 '21 16:03 jakebolewski

bors try

charleskawczynski avatar Mar 26 '21 18:03 charleskawczynski

try

Build failed:

bors[bot] avatar Mar 26 '21 18:03 bors[bot]

It looks like the next thing to try is to bump the version of KA / CUDA / GPUCompiler (ex. GPUCompiler is at 0.8.3 and the latest is 0.10.0 and all the 1.6 fixes were included in the 0.9+ releases).

I suspect the CPU test segfault is an OOB error, running locally to check.

jakebolewski avatar Mar 29 '21 15:03 jakebolewski

It looks like the advection / diffusion test segfault is not an OOB error (testing locally with --check-bounds=yes with 1.5.4) so something else is triggering that failure.

jakebolewski avatar Mar 29 '21 19:03 jakebolewski

bors try

charleskawczynski avatar Mar 29 '21 21:03 charleskawczynski

try

Build failed:

bors[bot] avatar Mar 29 '21 21:03 bors[bot]

CUDA.jl needs to be updated along with GPUCompiler.jl

jakebolewski avatar Mar 30 '21 18:03 jakebolewski

I'll give that a try, thanks!

charleskawczynski avatar Mar 30 '21 18:03 charleskawczynski

I just registered KernelAbstractions 0.6, but I would hold off on moving to that. KernelAbstraction 0.5.X should work well on Julia 1.6

vchuravy avatar Mar 30 '21 19:03 vchuravy

bors try

charleskawczynski avatar Mar 30 '21 22:03 charleskawczynski

try

Build failed:

bors[bot] avatar Mar 31 '21 00:03 bors[bot]

bors try

charleskawczynski avatar Apr 01 '21 23:04 charleskawczynski

try

Build failed:

bors[bot] avatar Apr 01 '21 23:04 bors[bot]

It would be nice to bump Cassette as well to https://github.com/JuliaLabs/Cassette.jl/releases/tag/v0.3.5 for the improved stacktraces as pointed out by @vchuravy

jakebolewski avatar Apr 02 '21 14:04 jakebolewski

It would be nice to bump Cassette as well to https://github.com/JuliaLabs/Cassette.jl/releases/tag/v0.3.5 for the improved stacktraces as pointed out by @vchuravy

It looks like we're already on Cassette 0.3.5

charleskawczynski avatar Apr 02 '21 15:04 charleskawczynski

It looks like if I ] add Cassette; up Cassette; rm Cassette, a few deps update, though, most notably GPUArrays (and Compat)

charleskawczynski avatar Apr 02 '21 15:04 charleskawczynski

bors try

charleskawczynski avatar Apr 02 '21 16:04 charleskawczynski

try

Build failed:

bors[bot] avatar Apr 02 '21 18:04 bors[bot]

bors try

charleskawczynski avatar Apr 02 '21 20:04 charleskawczynski