addprocs fails on Julia v1.8 triggering internal error

[GregPlowman]

addprocs() causes an error on Julia v1.8 (Windows 10).

It works as expected on Julia v1.6 and v1.7.

Error messages are not always the same, but always seems to be some sort on internal error.

Might be hitting some resource limit (memory?)

Since it works fine on earlier Julia versions, I was looking for any pointers to what changed in Julia v1.8, and any tips on how to further diagnose the issue?

julia> versioninfo()

Julia Version 1.8.0-beta3
Commit 3e092a2521 (2022-03-29 15:42 UTC)
Platform Info:
  OS: Windows (x86_64-w64-mingw32)
  CPU: 48 × Intel(R) Xeon(R) CPU E5-2687W v4 @ 3.00GHz
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, broadwell)
  Threads: 2 on 48 virtual cores
Environment:
  JULIA_BITVISE = C:\Program Files (x86)\Bitvise SSH Client\sexec.exe
  JULIA_EDITOR = "C:\Program Files\Sublime Text\sublime_text.exe"
  JULIA_SHELL = cmd
  JULIA_NUM_THREADS = 2

Error message

Internal error: encountered unexpected error in runtime:
Internal error: encountered unexpected error in runtime:
Internal error: encountered unexpected error in runtime:
Internal error: encountered unexpected error in runtime:
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryErrorInternal error: encountered unexpected error in runtime:
Internal error: encountered unexpected error in runtime:
Internal error: encountered unexpected error in runtime:
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
Internal error: encountered unexpected error in runtime:
()
ReadOnlyMemoryErrorReadOnlyMemoryErrorReadOnlyMemoryError()
ReadOnlyMemoryError()
ReadOnlyMemoryErrorReadOnlyMemoryErrorReadOnlyMemoryErrorReadOnlyMemoryError(((((())))
)


)

Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
Internal error: encountered unexpected error in runtime:
Internal error: encountered unexpected error in runtime:
Internal error: encountered unexpected error in runtime:
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryErrorReadOnlyMemoryError(ReadOnlyMemoryError())(ReadOnlyMemoryError(
)
)

reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
ijl_gc_pool_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1277
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
jl_gc_pool_alloc_noinline at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1287 [inlined]
jl_gc_alloc_ at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:368 [inlined]
jl_gc_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:3352
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
ijl_gc_pool_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1277
ijl_new_structv at /cygdrive/c/buildbot/worker/package_win64/build/src\datatype.c:1290
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
jl_gc_pool_alloc_noinline at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1287 [inlined]
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
jl_gc_alloc_ at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:368 [inlined]
jl_gc_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:3352
jl_gc_pool_alloc_noinline at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1287 [inlined]
jl_gc_alloc_ at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:368 [inlined]
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
jl_gc_pool_alloc_noinline at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1287 [inlined]
jl_gc_alloc_ at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:368 [inlined]
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
jl_gc_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:3352
ijl_gc_pool_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1277
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
jl_gc_pool_alloc_noinline at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1287 [inlined]
jl_gc_alloc_ at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:368 [inlined]
jl_gc_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:3352
jl_gc_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:3352
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
jl_gc_pool_alloc_noinline at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1287 [inlined]
ijl_gc_pool_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1277
jl_gc_alloc_ at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:368 [inlined]
jl_gc_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:3352
_new_array_ at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:134 [inlined]
_new_array at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:198 [inlined]
ijl_alloc_array_1d at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:436
_new_array_ at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:134 [inlined]
_new_array at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:198 [inlined]
ijl_alloc_array_1d at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:436
_new_array_ at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:134 [inlined]
_new_array_ at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:134 [inlined]
_new_array at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:198 [inlined]
_new_array at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:198 [inlined]
ijl_alloc_array_1d at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:436
ijl_alloc_array_1d at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:436
jl_gc_alloc_buf at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:403 [inlined]
jl_gc_alloc_buf at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:401 [inlined]
array_resize_buffer at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:698
jl_array_grow_at_end at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:893
ijl_array_grow_end at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:955 [inlined]
ijl_array_sizehint at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:1169
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
ijl_gc_pool_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1277
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
jl_gc_pool_alloc_noinline at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1287 [inlined]
ijl_gc_pool_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1277
jl_gc_alloc_ at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:368 [inlined]
jl_gc_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:3352
_new_array_ at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:134
ijl_array_copy at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:1181
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
jl_gc_pool_alloc_noinline at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1287 [inlined]
jl_gc_alloc_ at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:368 [inlined]
jl_gc_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:3352
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
jl_gc_pool_alloc_noinline at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1287 [inlined]
jl_gc_alloc_ at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:368 [inlined]
jl_gc_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:3352
jl_gc_alloc_buf at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:403 [inlined]
jl_gc_alloc_buf at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:401 [inlined]
array_resize_buffer at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:698
jl_array_grow_at_end at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:893
_new_array_ at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:134 [inlined]
_new_array at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:198 [inlined]
ijl_alloc_array_1d at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:436
fatal: error thrown and no exception handler available.
InitError(mod=:Profile, error=ErrorException("could not allocate space for 10000000 instruction pointers per thread being profiled (1 threads, 76.294 MiB total)"))
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError(
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: )
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- UNKNOWN at 0x7ffb34844fd9 --

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
fatal: error thrown and no exception handler available.
InitError(mod=:Profile, error=ErrorException("could not allocate space for 10000000 instruction pointers per thread being profiled (1 threads, 76.294 MiB total)"))
unknown function (ip: 000000000f911e7e)
unknown function (ip: 000000000ff64ae9)
unknown function (ip: 000000000f8896ee)
unknown function (ip: 000000000f88970e)
jl_module_run_initializer at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
ijl_maxrss at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
Internal error: encountered unexpected error in runtime:
jl_repl_entrypoint at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
ReadOnlyMemoryError()
mainCRTStartup at /cygdrive/c/buildbot/worker/package_win64/build/cli\loader_exe.c:59
BaseThreadInitThunk at C:\WINDOWS\System32\KERNEL32.DLL (unknown line)
RtlUserThreadStart at C:\WINDOWS\SYSTEM32\ntdll.dll (unknown line)
Internal error: encountered unexpected error in runtime:
unknown function (ip: 0000000065475179)
ReadOnlyMemoryErrorunknown function (ip: 000000006547e047)
()unknown function (ip: 000000006543f4c6)

unknown function (ip: 000000006543fb3b)
unknown function (ip: 0000000065443efc)
unknown function (ip: 000000000fe2a7c8)
unknown function (ip: 000000000fe2b0b3)
unknown function (ip: 000000000fe26d11)
unknown function (ip: 000000001007ed27)
unknown function (ip: 000000001007fccc)
unknown function (ip: 000000000fe26970)
unknown function (ip: 000000000fe196cb)
unknown function (ip: 000000000fdad2d9)
unknown function (ip: 000000000f6a6c84)
unknown function (ip: 000000000f6a6e47)
unknown function (ip: 0000000010084623)
unknown function (ip: 000000000fdba008)
unknown function (ip: 000000001007c236)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: unknown function (ip: 000000000fdbbb5d)
UNKNOWNunknown function (ip: 000000000f6bb143)
unknown function (ip: 000000000f6bb4ab)
 at 0x7ffb34844fd9 -- unknown function (ip: 000000000f6bb4e8)
unknown function (ip: 0000000065419e9e)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
unknown function (ip: 0000000065475179)
unknown function (ip: 000000006547e047)
unknown function (ip: 000000006543f4c6)
unknown function (ip: 000000006543fb3b)
unknown function (ip: 000000000f86beaf)
unknown function (ip: 000000000fe0dcc8)
unknown function (ip: 000000000fe09c50)
unknown function (ip: 00000000100cc236)
unknown function (ip: 000000000fe0bb5d)
unknown function (ip: 000000000f70b143)
unknown function (ip: 000000000f70b4ab)
unknown function (ip: 000000000f70b4e8)
unknown function (ip: 0000000065419e9e)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- unknown function (ip: 00000000691ec7b5)
unknown function (ip: 00000000654197e9)
unknown function (ip: 000000006541c436)
unknown function (ip: 000000000f6265f6)
unknown function (ip: 000000000f6268be)
unknown function (ip: 0000000065458fe4)
unknown function (ip: 000000006543c823)
unknown function (ip: 00000000654880a6)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- mainCRTStartup at /cygdrive/c/buildbot/worker/package_win64/build/cli\loader_exe.c:59
unknown function (ip: 00007ffb35147033)
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
unknown function (ip: 00007ffb36de2650)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception:
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWNUNKNOWN at 0x7ffb34844fd9 --  at 0x7ffb34844fd9 -- Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
Internal error: encountered unexpected error in runtime:

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: ReadOnlyMemoryError(UNKNOWN) at 0x7ffb34844fd9 --
unknown function (ip: 00007ffb34844fd9)
in expression starting at none:0
unknown function (ip: 00007ffb34844fd9)
_Unwind_RaiseException at /workspace/srcdir/gcc-11.1.0/libgcc\unwind-seh.c:334

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception:  at 0x7ffb34844fd9 -- UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- __cxa_throw at /workspace/srcdir/gcc-11.1.0/libstdc++-v3/libsupc++\eh_throw.cc:90

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: operator new at /workspace/srcdir/gcc-11.1.0/libstdc++-v3/libsupc++\new_op.cc:54
UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
.text$_ZNK4llvm16X86TargetMachine16getSubtargetImplERKNS_8FunctionE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
.text$_ZN4llvm16X86TargetMachine22getTargetTransformInfoERKNS_8FunctionE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
.text$_ZNSt17_Function_handlerIFN4llvm19TargetTransformInfoERKNS0_8FunctionEEZNS0_13TargetMachine19getTargetIRAnalysisEvEUlS4_E_E9_M_invokeERKSt9_Any_dataS4_ at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
reset_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1179 [inlined]
add_page at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1211
jl_gc_pool_alloc_inner at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1266 [inlined]
jl_gc_pool_alloc_noinline at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:1287 [inlined]
jl_gc_alloc_ at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:368 [inlined]
jl_gc_alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\gc.c:3352
.text$_ZN4llvm30TargetTransformInfoWrapperPass6getTTIERKNS_8FunctionE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
jl_gc_alloc_buf at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:403 [inlined]
jl_gc_alloc_buf at /cygdrive/c/buildbot/worker/package_win64/build/src\julia_internal.h:401 [inlined]
array_resize_buffer at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:698
jl_array_grow_at_end at /cygdrive/c/buildbot/worker/package_win64/build/src\array.c:893
unknown function (ip: 000000000ffd92dd)
unknown function (ip: 000000000ff845ab)
unknown function (ip: 000000000ffc6565)
unknown function (ip: 000000001024b9f9)
unknown function (ip: 000000000ffcc2c4)
unknown function (ip: 000000000ffd2bad)
unknown function (ip: 000000000ffd5c7e)
unknown function (ip: 000000000ff89a39)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: unknown function (ip: 000000001024c236)
UNKNOWNunknown function (ip: 000000000ff8bb5d)
 at 0x7ffb34844fd9 -- unknown function (ip: 000000000f88b143)
unknown function (ip: 000000000f88b4ab)
unknown function (ip: 000000000f88b4e8)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- .text$_ZN12_GLOBAL__N_115CFGSimplifyPass13runOnFunctionERN4llvm8FunctionE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
_jl_invoke at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:2358 [inlined]
ijl_apply_generic at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:2540 [inlined]
jl_apply at /cygdrive/c/buildbot/worker/package_win64/build/src\julia.h:1831 [inlined]
jl_type_infer at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:319
.text$_ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- .text$_ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
.text$_ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
unknown function (ip: 00000000691e39f5)
.text$_ZN4llvm3orc14IRCompileLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- .text$_ZN4llvm3orc31BasicIRLayerMaterializationUnit11materializeESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
.text$_ZN4llvm3orc19MaterializationTask3runEv at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
_ZN4llvm6detail18UniqueFunctionBaseIvJSt10unique_ptrINS_3orc4TaskESt14default_deleteIS4_EEEE8CallImplIPFvS7_EEEvPvRS7_ at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- .text$_ZN4llvm3orc16ExecutionSession22dispatchOutstandingMUsEv at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
unknown function (ip: 00007ffb34844fd9)
in expression starting at none:0
unknown function (ip: 00007ffb34844fd9)
.text$_ZN4llvm3orc16ExecutionSession17OL_completeLookupESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EESt10shared_ptrINS0_23AsynchronousSymbolQueryEESt8functionIFvRKNS_8DenseMapIPNS0_8JITDylibENS_8DenseSetINS0_15SymbolStringPtrENS_12DenseMapInfoISF_EEEENSG_ISD_EENS_6detail12DenseMapPairISD_SI_EEEEEE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
_ZN4llvm3orc25InProgressFullLookupState8completeESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
.text$_ZN4llvm3orc16ExecutionSession19OL_applyQueryPhase1ESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EENS_5ErrorE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
.text$_ZN4llvm3orc16ExecutionSession6lookupENS0_10LookupKindERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS8_EENS0_15SymbolLookupSetENS0_11SymbolStateENS_15unique_functionIFvNS_8ExpectedINS_8DenseMapINS0_15SymbolStringPtrENS_18JITEvaluatedSymbolENS_12DenseMapInfoISI_EENS_6detail12DenseMapPairISI_SJ_EEEEEEEEESt8functionIFvRKNSH_IS6_NS_8DenseSetISI_SL_EENSK_IS6_EENSN_IS6_SV_EEEEEE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
.text$_ZN4llvm3orc16ExecutionSession6lookupERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS7_EERKNS0_15SymbolLookupSetENS0_10LookupKindENS0_11SymbolStateESt8functionIFvRKNS_8DenseMapIS5_NS_8DenseSetINS0_15SymbolStringPtrENS_12DenseMapInfoISK_EEEENSL_IS5_EENS_6detail12DenseMapPairIS5_SN_EEEEEE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
.text$_ZN4llvm3orc16ExecutionSession6lookupERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS7_EENS0_15SymbolStringPtrENS0_11SymbolStateE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
.text$_ZN4llvm3orc16ExecutionSession6lookupENS_8ArrayRefIPNS0_8JITDylibEEENS0_15SymbolStringPtrENS0_11SymbolStateE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
_Unwind_RaiseException at /workspace/srcdir/gcc-11.1.0/libgcc\unwind-seh.c:334
.text$_ZN4llvm3orc16ExecutionSession6lookupENS_8ArrayRefIPNS0_8JITDylibEEENS_9StringRefENS0_11SymbolStateE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
unknown function (ip: 00000000691e8492)
unknown function (ip: 00000000691e8b5b)
unknown function (ip: 00000000691e98b6)
unknown function (ip: 00000000691ec495)
unknown function (ip: 00000000691ecadb)
unknown function (ip: 0000000065419b1f)
unknown function (ip: 000000006541c436)
unknown function (ip: 000000000f6265f6)
unknown function (ip: 000000000f6268be)
unknown function (ip: 0000000065458fe4)
unknown function (ip: 000000006543c823)
unknown function (ip: 00000000654880a6)
mainCRTStartup at /cygdrive/c/buildbot/worker/package_win64/build/cli\loader_exe.c:59
unknown function (ip: 00007ffb35147033)
unknown function (ip: 00007ffb36de2650)
Allocations: 2900 (Pool: 2889; Big: 11); GC: 0
unknown function (ip: 00007ffaf0e53c0a)
unknown function (ip: 00007ffaf0e53222)
unknown function (ip: 000000000632527e)
unknown function (ip: 00000000055c966f)
unknown function (ip: 0000000006612210)
unknown function (ip: 0000000005a77cb8)
unknown function (ip: 000000000476f9ab)
unknown function (ip: 00000000050122fc)
unknown function (ip: 0000000005011f52)
unknown function (ip: 0000000005d68ded)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- Cannot protect page @0000000000000000 of size 1048576 to 0x4 (err 0x1e7)

signal (22): SIGABRT
in expression starting at none:0
RaiseException at C:\WINDOWS\System32\KERNELBASE.dll (unknown line)
in expression starting at none:0
RaiseException at C:\WINDOWS\System32\KERNELBASE.dll (unknown line)
_Unwind_RaiseException at /workspace/srcdir/gcc-11.1.0/libgcc\unwind-seh.c:334

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- crt_sig_handler at /cygdrive/c/buildbot/worker/package_win64/build/src\signals-win.c:93
raise at C:\WINDOWS\System32\msvcrt.dll (unknown line)
abort at C:\WINDOWS\System32\msvcrt.dll (unknown line)
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
ijl_print_backtrace at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
fatal: error thrown and no exception handler available.
jl_gc_alloc at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
InitErrorijl_alloc_array_1d at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
(ijl_uncompress_argnames at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
mod=ijl_uncompress_ir at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
:Profile, error=ErrorException("could not allocate space for 10000000 instruction pointers per thread being profiled (1 threads, 76.294 MiB total)"))
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception:
UNKNOWN at 0x7ffb34844fd9 -- unknown function (ip: 000000001024ecf5)
unknown function (ip: 000000001024fccc)
unknown function (ip: 000000000fff6970)
unknown function (ip: 000000000ffe96cb)
unknown function (ip: 000000000ff7d2d9)
unknown function (ip: 000000000f876c84)
unknown function (ip: 000000000f876e47)
unknown function (ip: 0000000010254623)
unknown function (ip: 000000000ff8a008)
unknown function (ip: 000000001024c236)
unknown function (ip: 00000000102557ff)
unknown function (ip: 00000000100238b4)
unknown function (ip: 000000000ffd91a0)
unknown function (ip: 000000000ff845ab)
unknown function (ip: 000000000ffc6565)
unknown function (ip: 000000001024b9f9)
unknown function (ip: 000000000ffcc2c4)
unknown function (ip: 000000000ffd3624)
unknown function (ip: 000000000ffd5c7e)
unknown function (ip: 000000000ff89a39)
unknown function (ip: 000000001024c236)
unknown function (ip: 00000000102557ff)
unknown function (ip: 00000000100238b4)
unknown function (ip: 000000000ffd91a0)
unknown function (ip: 000000000ff845ab)
unknown function (ip: 000000000ffc6565)
unknown function (ip: 000000001024b9f9)
unknown function (ip: 000000000ffcc2c4)
unknown function (ip: 000000000ffd2bad)
unknown function (ip: 000000000ffd5c7e)
unknown function (ip: 000000000ff89a39)
unknown function (ip: 000000001024c236)
unknown function (ip: 00000000102557ff)
unknown function (ip: 00000000100238b4)
unknown function (ip: 000000000ffd91a0)
unknown function (ip: 000000000ff845ab)
unknown function (ip: 000000000ffc6565)
unknown function (ip: 000000001024b9f9)
unknown function (ip: 000000000ffcc2c4)
unknown function (ip: 000000000ffd2bad)
unknown function (ip: 000000000ffd5c7e)
unknown function (ip: 000000000ff89a39)
unknown function (ip: 000000001024c236)
unknown function (ip: 000000000ff8bb5d)
unknown function (ip: 000000000f88b143)
unknown function (ip: 000000000f88b4ab)
unknown function (ip: 000000000f88b4e8)
jl_type_infer at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
unknown function (ip: 000000000f881e7e)
unknown function (ip: 000000000fed4ae9)
jl_generate_fptr_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
unknown function (ip: 000000000f7f96ee)
jl_get_unspecialized at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
unknown function (ip: 000000000f7f970e)
ijl_apply_generic at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
jl_finish_task at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- jl_apply at /cygdrive/c/buildbot/worker/package_win64/build/src\julia.h:1831 [inlined]
jl_module_run_initializer at /cygdrive/c/buildbot/worker/package_win64/build/src\toplevel.c:75
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
ijl_print_backtrace at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
jl_gc_alloc at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
jl_gdb_dump_threadinfo at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
jl_gdb_dump_threadinfo at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- RaiseException at C:\WINDOWS\System32\KERNELBASE.dll (unknown line)
in expression starting at REPL[2]:1
RaiseException at C:\WINDOWS\System32\KERNELBASE.dll (unknown line)
_Unwind_RaiseException at /workspace/srcdir/gcc-11.1.0/libgcc\unwind-seh.c:334

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- RaiseException at C:\WINDOWS\System32\KERNELBASE.dll (unknown line)
in expression starting at none:0
RaiseException at C:\WINDOWS\System32\KERNELBASE.dll (unknown line)
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
ijl_print_backtrace at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
ijl_gc_pool_alloc at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
unknown function (ip: 00000000101bf45b)
unknown function (ip: 000000000ff59aff)
unknown function (ip: 000000000feed2d9)
unknown function (ip: 000000000f7e6c84)
unknown function (ip: 000000000f7e6e47)
unknown function (ip: 00000000101c4623)
unknown function (ip: 000000000fefa008)
unknown function (ip: 00000000101bc236)
unknown function (ip: 000000000fefbb5d)
unknown function (ip: 000000000f7fb143)
unknown function (ip: 000000000f7fb4ab)
unknown function (ip: 0000000065475179)
unknown function (ip: 000000000f7fb4e8)
unknown function (ip: 000000006547d5c7)
jl_type_infer at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
unknown function (ip: 000000000fffe13b)
_Unwind_RaiseException at /workspace/srcdir/gcc-11.1.0/libgcc\unwind-seh.c:334
unknown function (ip: 000000000fff9c50)
unknown function (ip: 00000000102bc236)
unknown function (ip: 000000000fffbb5d)
unknown function (ip: 000000000f8fb143)
unknown function (ip: 000000000f8fb4ab)
unknown function (ip: 000000000f8fb4e8)
jl_type_infer at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
unknown function (ip: 000000000ff6e13b)
unknown function (ip: 000000000ff69c50)
unknown function (ip: 000000001022c236)
unknown function (ip: 000000000ff6bb5d)
unknown function (ip: 000000000f86b143)
unknown function (ip: 000000000f86b4ab)
unknown function (ip: 000000000f86b4e8)
unknown function (ip: 0000000065419e9e)
jl_generate_fptr_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
unknown function (ip: 00000000654197e9)
unknown function (ip: 000000006541c436)
unknown function (ip: 000000000f7865f6)
unknown function (ip: 000000000f7868be)
unknown function (ip: 0000000065458fe4)
unknown function (ip: 000000006543c823)
unknown function (ip: 00000000654880a6)
unknown function (ip: 00000000691ec7b5)
jl_get_unspecialized at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
ijl_apply_generic at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
unknown function (ip: 000000000f8165f6)
unknown function (ip: 000000000f8168be)
jl_module_run_initializer at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
ijl_maxrss at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
jl_repl_entrypoint at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- RaiseException at C:\WINDOWS\System32\KERNELBASE.dll (unknown line)
in expression starting at none:0
RaiseException at C:\WINDOWS\System32\KERNELBASE.dll (unknown line)
_Unwind_RaiseException at /workspace/srcdir/gcc-11.1.0/libgcc\unwind-seh.c:334
Internal error: encountered unexpected error in runtime:
_cxa_throw at C:\Program Files\Julia-1.8.0-beta3\bin\libstdc++-6.dll (unknown line)
ReadOnlyMemoryErrorZnwy at C:\Program Files\Julia-1.8.0-beta3\bin\libstdc++-6.dll (unknown line)
()
ZN4llvm8DenseMapIPNS_10DILocationENS_6detail13DenseSetEmptyENS_10MDNodeInfoIS1_EENS3_12DenseSetPairIS2_EEE4growEj at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm6MDNode9storeImplINS_10DILocationENS_8DenseSetIPS2_NS_10MDNodeInfoIS2_EEEEEEPT_S9_NS_8Metadata11StorageTypeERT0_ at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm10DILocation7getImplERNS_11LLVMContextEjjPNS_8MetadataES4_bNS3_11StorageTypeEb at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
jl_type_to_llvm_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_type_to_llvm_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_type_to_llvm_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_compile_extern_c_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_generate_fptr_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_get_unspecialized at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
ijl_apply_generic at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
#start_worker#34 at C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:236
start_worker at C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:233
unknown function (ip: 000000005fd09f6a)
#start_worker#33 at C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:231
start_worker at C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:231 [inlined]
start_worker at C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:231

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: process_opts at C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:1325
UNKNOWNunknown function (ip: 000000005fd06d60)
 at 0x7ffb34844fd9 -- jl_f__call_latest at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
unknown function (ip: 000000000fca711d)
unknown function (ip: 000000000f4b10c0)
unknown function (ip: 000000000f4b120e)
ijl_call2 at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
jl_repl_entrypoint at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
mainCRTStartup at /cygdrive/c/buildbot/worker/package_win64/build/cli\loader_exe.c:59
BaseThreadInitThunk at C:\WINDOWS\System32\KERNEL32.DLL (unknown line)
RtlUserThreadStart at C:\WINDOWS\SYSTEM32\ntdll.dll (unknown line)
Allocations: 1686796 (Pool: 1685866; Big: 930); GC: 1

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: EXCEPTION_ACCESS_VIOLATION at 0x4d6ec97 -- ZN4llvm10DILocation7getImplERNS_11LLVMContextEjjPNS_8MetadataES4_bNS3_11StorageTypeEb at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
in expression starting at none:0
ZN4llvm10DILocation7getImplERNS_11LLVMContextEjjPNS_8MetadataES4_bNS3_11StorageTypeEb at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
jl_type_to_llvm_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_type_to_llvm_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_type_to_llvm_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_compile_extern_c_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_generate_fptr_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_get_unspecialized at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
ijl_apply_generic at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
jl_f__call_in_world_total at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
jl_f__setsuper at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
unknown function (ip: 000000000fea4be1)
unknown function (ip: 000000000fea582d)
unknown function (ip: 000000000fe893e4)
unknown function (ip: 000000000fe345ab)
unknown function (ip: 000000000fe76565)
unknown function (ip: 00000000100fb9f9)
unknown function (ip: 000000000fe7c2c4)
unknown function (ip: 000000000fe82bad)
unknown function (ip: 000000000fe85c7e)
unknown function (ip: 000000000fe39a39)
unknown function (ip: 00000000100fc236)
unknown function (ip: 000000000fe3bb5d)
unknown function (ip: 000000000f73b143)
unknown function (ip: 000000000f73b4ab)
unknown function (ip: 000000000f73b4e8)
jl_type_infer at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
jl_generate_fptr_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_get_unspecialized at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
ijl_apply_generic at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
unknown function (ip: 000000000fcff265)
unknown function (ip: 000000000f53ae7f)
ijl_atexit_hook at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
ijl_exit at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
jl_exception_handler at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
_julia_personality at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
_chkstk at C:\WINDOWS\SYSTEM32\ntdll.dll (unknown line)
RtlRaiseException at C:\WINDOWS\SYSTEM32\ntdll.dll (unknown line)
RtlRaiseException at C:\WINDOWS\SYSTEM32\ntdll.dll (unknown line)
RaiseException at C:\WINDOWS\System32\KERNELBASE.dll (unknown line)
_Unwind_RaiseException at /workspace/srcdir/gcc-11.1.0/libgcc\unwind-seh.c:334
_cxa_throw at C:\Program Files\Julia-1.8.0-beta3\bin\libstdc++-6.dll (unknown line)
Znwy at C:\Program Files\Julia-1.8.0-beta3\bin\libstdc++-6.dll (unknown line)
ZN4llvm8DenseMapIPNS_10DILocationENS_6detail13DenseSetEmptyENS_10MDNodeInfoIS1_EENS3_12DenseSetPairIS2_EEE4growEj at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm6MDNode9storeImplINS_10DILocationENS_8DenseSetIPS2_NS_10MDNodeInfoIS2_EEEEEEPT_S9_NS_8Metadata11StorageTypeERT0_ at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm10DILocation7getImplERNS_11LLVMContextEjjPNS_8MetadataES4_bNS3_11StorageTypeEb at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
jl_type_to_llvm_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_type_to_llvm_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_type_to_llvm_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_compile_extern_c_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_generate_fptr_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_get_unspecialized at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
ijl_apply_generic at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
#start_worker#34 at C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:236
start_worker at C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:233
unknown function (ip: 000000005fd09f6a)
#start_worker#33 at C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:231
start_worker at C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:231 [inlined]
start_worker at C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:231
process_opts at C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:1325
unknown function (ip: 000000005fd06d60)
jl_f__call_latest at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
unknown function (ip: 000000000fca711d)
unknown function (ip: 000000000f4b10c0)
unknown function (ip: 000000000f4b120e)
ijl_call2 at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
jl_repl_entrypoint at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-internal.dll (unknown line)
mainCRTStartup at /cygdrive/c/buildbot/worker/package_win64/build/cli\loader_exe.c:59
BaseThreadInitThunk at C:\WINDOWS\System32\KERNEL32.DLL (unknown line)
RtlUserThreadStart at C:\WINDOWS\SYSTEM32\ntdll.dll (unknown line)
Allocations: 1686796 (Pool: 1685866; Big: 930); GC: 1

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- WARNING: Error during initialization of module LinearAlgebra:
ErrorException("could not load library "libblastrampoline"
The paging file is too small for this operation to complete. ")
WARNING: Error during initialization of module LinearAlgebra:
ErrorException("could not load library "libblastrampoline"
The paging file is too small for this operation to complete. ")
fatal: error thrown and no exception handler available.
InitError(mod=:Profile, error=ErrorException("could not allocate space for 10000000 instruction pointers per thread being profiled (1 threads, 76.294 MiB total)"))

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- fatal: error thrown and no exception handler available.
InitError(mod=:LibCURL_jll, error=ErrorException("could not load library "libcurl-4.dll"
The paging file is too small for this operation to complete. "))
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
ijl_errorf at /cygdrive/c/buildbot/worker/package_win64/build/src\rtutils.c:77
ijl_load_dynamic_library at /cygdrive/c/buildbot/worker/package_win64/build/src\dlload.c:273
unknown function (ip: 000000000f6bdcb8)
unknown function (ip: 000000000f6bdeee)
unknown function (ip: 000000000f6be12e)
Cannot protect page @0000000000000000 of size 1048576 to 0x4 (err 0x1e7)

signal (22): SIGABRT
in expression starting at none:0
Cannot protect page @0000000000000000 of size 1048576 to 0x4 (err 0x1e7)

signal (22): SIGABRT
in expression starting at none:0
jl_apply at /cygdrive/c/buildbot/worker/package_win64/build/src\julia.h:1831 [inlined]
jl_module_run_initializer at /cygdrive/c/buildbot/worker/package_win64/build/src\toplevel.c:75
crt_sig_handler at /cygdrive/c/buildbot/worker/package_win64/build/src\signals-win.c:93
unknown function (ip: 00007ffb367dadfa)
unknown function (ip: 00007ffb367df1fa)
_finish_julia_init at /cygdrive/c/buildbot/worker/package_win64/build/src\init.c:763
jl_repl_entrypoint at /cygdrive/c/buildbot/worker/package_win64/build/src\jlapi.c:705
crt_sig_handler at /cygdrive/c/buildbot/worker/package_win64/build/src\signals-win.c:93
mainCRTStartup at /cygdrive/c/buildbot/worker/package_win64/build/cli\loader_exe.c:59
unknown function (ip: 00007ffb367dadfa)
unknown function (ip: 00007ffb367df1fa)
unknown function (ip: 00007ffb35147033)
LLVMExtraAddAllocOptPass_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
uv_process_async_wakeup_req at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
unknown function (ip: 00007ffb36de2650)
ZN4llvm15RuntimeDyldImpl11emitSectionERKNS_6object10ObjectFileERKNS1_10SectionRefEb at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm15RuntimeDyldImpl17findOrEmitSectionERKNS_6object10ObjectFileERKNS1_10SectionRefEbRSt3mapIS5_jSt4lessIS5_ESaISt4pairIS6_jEEE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm15RuntimeDyldImpl14loadObjectImplERKNS_6object10ObjectFileE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm14RuntimeDyldELF10loadObjectERKNS_6object10ObjectFileE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
protect_page at /cygdrive/c/buildbot/worker/package_win64/build/src\cgmemmgr.cpp:78 [inlined]
ZN4llvm11RuntimeDyld10loadObjectERKNS_6object10ObjectFileE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
get_wr_ptr at /cygdrive/c/buildbot/worker/package_win64/build/src\cgmemmgr.cpp:609 [inlined]
alloc at /cygdrive/c/buildbot/worker/package_win64/build/src\cgmemmgr.cpp:585 [inlined]
ZN4llvm13jitLinkForORCENS_6object12OwningBinaryINS0_10ObjectFileEEERNS_11RuntimeDyld13MemoryManagerERNS_17JITSymbolResolverEbNS_15unique_functionIFNS_5ErrorERKS2_RNS4_16LoadedObjectInfoESt3mapINS_9StringRefENS_18JITEvaluatedSymbolESt4lessISG_ESaISt4pairIKSG_SH_EEEEEENS9_IFvS3_St10unique_ptrISD_St14default_deleteISD_EESA_EEE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
allocateCodeSection at /cygdrive/c/buildbot/worker/package_win64/build/src\cgmemmgr.cpp:863
ZN4llvm3orc24RTDyldObjectLinkingLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EES2_INS_12MemoryBufferES4_IS7_EE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm3orc14IRCompileLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm3orc31BasicIRLayerMaterializationUnit11materializeESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm3orc19MaterializationTask3runEv at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm6detail18UniqueFunctionBaseIvJSt10unique_ptrINS_3orc4TaskESt14default_deleteIS4_EEEE8CallImplIPFvS7_EEEvPvRS7_ at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm3orc16ExecutionSession22dispatchOutstandingMUsEv at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm3orc16ExecutionSession17OL_completeLookupESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EESt10shared_ptrINS0_23AsynchronousSymbolQueryEESt8functionIFvRKNS_8DenseMapIPNS0_8JITDylibENS_8DenseSetINS0_15SymbolStringPtrENS_12DenseMapInfoISF_EEEENSG_ISD_EENS_6detail12DenseMapPairISD_SI_EEEEEE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm3orc25InProgressFullLookupState8completeESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm3orc16ExecutionSession19OL_applyQueryPhase1ESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EENS_5ErrorE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm3orc16ExecutionSession6lookupENS0_10LookupKindERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS8_EENS0_15SymbolLookupSetENS0_11SymbolStateENS_15unique_functionIFvNS_8ExpectedINS_8DenseMapINS0_15SymbolStringPtrENS_18JITEvaluatedSymbolENS_12DenseMapInfoISI_EENS_6detail12DenseMapPairISI_SJ_EEEEEEEEESt8functionIFvRKNSH_IS6_NS_8DenseSetISI_SL_EENSK_IS6_EENSN_IS6_SV_EEEEEE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm3orc16ExecutionSession6lookupERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS7_EERKNS0_15SymbolLookupSetENS0_10LookupKindENS0_11SymbolStateESt8functionIFvRKNS_8DenseMapIS5_NS_8DenseSetINS0_15SymbolStringPtrENS_12DenseMapInfoISK_EEEENSL_IS5_EENS_6detail12DenseMapPairIS5_SN_EEEEEE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm3orc16ExecutionSession6lookupERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS7_EENS0_15SymbolStringPtrENS0_11SymbolStateE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm3orc16ExecutionSession6lookupENS_8ArrayRefIPNS0_8JITDylibEEENS0_15SymbolStringPtrENS0_11SymbolStateE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
ZN4llvm3orc16ExecutionSession6lookupENS_8ArrayRefIPNS0_8JITDylibEEENS_9StringRefENS0_11SymbolStateE at C:\Program Files\Julia-1.8.0-beta3\bin\libLLVM-13jl.dll (unknown line)
jl_jit_total_bytes_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_jit_total_bytes_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_jit_total_bytes_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
jl_compile_extern_c_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: jl_generate_fptr_impl at C:\Program Files\Julia-1.8.0-beta3\bin\libjulia-codegen.dll (unknown line)
UNKNOWN at 0x7ffb34844fd9 --
Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: UNKNOWN at 0x7ffb34844fd9 -- jl_compile_method_internal at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:2072
jl_compile_method_internal at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:2019 [inlined]
_jl_invoke at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:2350 [inlined]
ijl_apply_generic at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:2540
__init__ at C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.8\LinearAlgebra\src\LinearAlgebra.jl:580
jfptr___init___66804.clone_1 at C:\Program Files\Julia-1.8.0-beta3\lib\julia\sys.dll (unknown line)
jl_apply at /cygdrive/c/buildbot/worker/package_win64/build/src\julia.h:1831 [inlined]
jl_module_run_initializer at /cygdrive/c/buildbot/worker/package_win64/build/src\toplevel.c:75
_finish_julia_init at /cygdrive/c/buildbot/worker/package_win64/build/src\init.c:763
jl_repl_entrypoint at /cygdrive/c/buildbot/worker/package_win64/build/src\jlapi.c:705
mainCRTStartup at /cygdrive/c/buildbot/worker/package_win64/build/cli\loader_exe.c:59
unknown function (ip: 00007ffb35147033)
unknown function (ip: 00007ffb36de2650)
Allocations: 2901 (Pool: 2890; Big: 11); GC: 0

[Moelf]

does this happen on the nightly?

[KristofferC]

On beta3 for me:

julia> using Distributed
 
julia> addprocs(1)
1-element Vector{Int64}:
 2
 
julia> addprocs(1)
fatal: error thrown and no exception handler available.
InitError(mod=:Profile, error=ErrorException("could not allocate space for 10000000 instruction pointers per thread being profiled (1 threads, 76.294 MiB total)"))
ERROR: TaskFailedException
 
    nested task error: Unable to read host:port string from worker. Launch command exited with error?
    Stacktrace:
     [1] worker_from_id(pg::Distributed.ProcessGroup, i::Int64)
       @ Distributed C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:1089
     [2] worker_from_id
       @ C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:1086 [inlined]
     [3] #remote_do#170
       @ C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\remotecall.jl:557 [inlined]
     [4] remote_do
       @ C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\remotecall.jl:557 [inlined]
     [5] kill
       @ C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\managers.jl:687 [inlined]
     [6] create_worker(manager::Distributed.LocalManager, wconfig::WorkerConfig)
       @ Distributed C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:600
     [7] setup_launched_worker(manager::Distributed.LocalManager, wconfig::WorkerConfig, launched_q::Vector{Int64})
       @ Distributed C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:541
     [8] (::Distributed.var"#45#48"{Distributed.LocalManager, Vector{Int64}, WorkerConfig})()
       @ Distributed .\task.jl:482
 
    caused by: Unable to read host:port string from worker. Launch command exited with error?
    Stacktrace:
     [1] read_worker_host_port(io::Base.PipeEndpoint)
       @ Distributed C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:327
     [2] connect(manager::Distributed.LocalManager, pid::Int64, config::WorkerConfig)
       @ Distributed C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\managers.jl:536
     [3] create_worker(manager::Distributed.LocalManager, wconfig::WorkerConfig)
       @ Distributed C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:596
     [4] setup_launched_worker(manager::Distributed.LocalManager, wconfig::WorkerConfig, launched_q::Vector{Int64})
       @ Distributed C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:541
     [5] (::Distributed.var"#45#48"{Distributed.LocalManager, Vector{Int64}, WorkerConfig})()
       @ Distributed .\task.jl:482
Stacktrace:
 [1] sync_end(c::Channel{Any})
   @ Base .\task.jl:434
 [2] macro expansion
   @ .\task.jl:453 [inlined]
 [3] addprocs_locked(manager::Distributed.LocalManager; kwargs::Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
   @ Distributed C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:487
 [4] addprocs_locked
   @ C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:454 [inlined]
 [5] addprocs(manager::Distributed.LocalManager; kwargs::Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
   @ Distributed C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:447
 [6] addprocs
   @ C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\cluster.jl:441 [inlined]
 [7] #addprocs#263
   @ C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\managers.jl:455 [inlined]
 [8] addprocs(np::Int64)
   @ Distributed C:\Users\Kristoffer\AppData\Local\Programs\Julia-1.8.0-beta3\share\julia\stdlib\v1.8\Distributed\src\managers.jl:453
 [9] top-level scope
   @ REPL[2]:1

[KristofferC]

Tangentially, isn't it a bit much for Profile to allocate 76 MB for every process getting started, even if Profile is not used?

[KristofferC]

The error I got above was on a VM, when I run it on my real Windows install (with more resources) I don't have an issue:

julia> VERSION
v"1.8.0-beta3"

julia> using Distributed

julia> addprocs(8)
8-element Vector{Int64}:
 2
 3
...

[GregPlowman]

does this happen on the nightly?

Yes, with slightly different error messages, but more severe consequences. PC appears to lock up. I thought it looked like out of memory, but task manager showed 12% memory before freezing.

The error I got above was on a VM, when I run it on my real Windows install (with more resources) I don't have an issue:

Have you tried addprocs(), which will start Sys.CPU_THREADS workers?

[KristofferC]

Have you tried addprocs(), to start Sys.CPU_THREADS workers?

It crashes then. I'll try to bisect it.

[KristofferC]

Hm, but I get this on 1.7 as well:

  | | |_| | | | (_| |  |  Version 1.7.2 (2022-02-06)
 _/ |\__'_|_|_|\__'_|  |  Official https://julialang.org/ release
|__/

julia> using Distributed

julia> addprocs(Sys.CPU_THREADS)
Internal error: encountered unexpected error in runtime:
Internal error: encountered unexpected error in runtime:
ReadOnlyMemoryErrorInternal error: encountered unexpected error in runtime:
ReadOnlyMemoryError()
ReadOnlyMemoryError()
()
unknown function (ip: 0000000002101c99)
unknown function (ip: 0000000002109f67)

[JeffBezanson]

The amount Profile allocates doesn't seem to have changed. In fact we use this logic:

    nthreads = Sys.iswindows() ? 1 : Threads.nthreads() # windows only profiles the main thread
    buffer_samples = n * nthreads

so on windows we should be passing the same value as before. Maybe random based on system conditions?

[Keno]

These ReadOnlyMemoryError errors happens when julia runs out of committed memory. For some reason, we've started using a metric ton of it, even though we're barely allocating any physical memory:

[vtjnash]

That is almost entirely due to OpenBLAS, to run on threads. We commit about 285 MB, then OpenBLAS commits about 915 MB. It goes away if you set OPENBLAS_NUM_THREADS=1.

[vtjnash]

The threads used to be somewhat lazily allocated, but that was removed in https://github.com/JuliaLang/julia/pull/42442, and that logic has not been restored, despite several PRs that attempted to do so, but which misunderstood the problem, and existing known solution, and it did not restore the test deleted by that PR (https://github.com/JuliaLang/julia/pull/45412, https://github.com/JuliaLang/julia/pull/42470, and to a lesser extent #30004)

[vtjnash]

n.b. that OpenBLAS memory usage scales fast as the product of the maximum number of threads configured and the current number of threads visible at startup, which was temporarily increased by https://github.com/JuliaPackaging/Yggdrasil/pull/3667, before being changed back to the old default

[KristofferC]

The threads used to be somewhat lazily allocated

I don't see how that used to be lazily allocated. Isn't the only change the number of buffers OpenBLAS end up creating, not lazy vs eager?

[vtjnash]

It used to set the initial thread count, then initialize openblas. Now it initializes openblas, then restricts the threads it can use. But openblas knows how to start them up lazily, it just doesn't.

[DilumAluthge]

Seems like this should be a 1.9 release blocker?

[PallHaraldsson]

FYI: This may be fixed by https://github.com/JuliaLang/julia/pull/47803#issuecomment-1338062937. Just commenting redundantly, I see it doesn't go to top of issue list by Kristoffer linking to it (nor if I sort by recent, I suppose it will now with my comment).

[KristofferC]

I believe this is fixed by https://github.com/JuliaLang/julia/pull/47803. Please comment if this is still an issue on Julia master (or 1.8.4) when that comes out.