Nanosoldier.jl icon indicating copy to clipboard operation
Nanosoldier.jl copied to clipboard

Hung due to network error

Open maleadt opened this issue 9 months ago • 1 comments

Feb 14 06:53:56:       From worker 2:        Running tests: 18557 remaining (ETA: 4:01:51)
Feb 14 06:59:22:       From worker 2:        ERROR session: fetching region failed: RequestError: send request failed
Feb 14 06:59:22:       From worker 2:        caused by: dial tcp: lookup julialang-reports.s3.amazonaws.com: no such host
Feb 14 07:00:11:       From worker 2:        ERROR "cp /tmp/pkgeval_Chevrons_dod8Th/output/Chevrons.tar.zst s3://julialang-reports/nanosoldier/pkgeval/rr/Chevrons-1739516317.tar.zst": RequestError: send request failed caused by: Post "https://julialang-reports.s3.amazonaws.com/nanosoldier/pkgeval/rr/Chevrons-173951631>
Feb 14 07:00:12:       From worker 2:        Caught an error, stopping...
Feb 14 07:01:14: ┌ Error: [Node 2 | 2025-02-14T07:01:14.047]: Encountered error: encountered job loop error: HTTP.Exceptions.ConnectError("https://api.github.com/repos/JuliaLang/julia/commits/20162ea3949c5e9cf8c803b5b2b7b249c57108e4/comments", CapturedException(DNSError: api.github.com, unknown node or service (EAI_NO>
Feb 14 07:01:14: │   exception =
Feb 14 07:01:14: │    HTTP.ConnectError for url = `https://api.github.com/repos/JuliaLang/julia/commits/20162ea3949c5e9cf8c803b5b2b7b249c57108e4/comments`: DNSError: api.github.com, unknown node or service (EAI_NONAME)
Feb 14 07:01:14: │    Stacktrace:
Feb 14 07:01:14: │     [1] getalladdrinfo(host::String)
Feb 14 07:01:14: │       @ Sockets ~/.julia/juliaup/julia-1.10.7+0.x64.linux.gnu/share/julia/stdlib/v1.10/Sockets/src/addrinfo.jl:113
Feb 14 07:01:14: │     [2] getalladdrinfo
Feb 14 07:01:14: │       @ ~/.julia/juliaup/julia-1.10.7+0.x64.linux.gnu/share/julia/stdlib/v1.10/Sockets/src/addrinfo.jl:122 [inlined]
Feb 14 07:01:14: │     [3] getconnection(::Type{TCPSocket}, host::SubString{String}, port::String; keepalive::Bool, readtimeout::Int64, kw::@Kwargs{require_ssl_verification::Bool, iofunction::Nothing, decompress::Nothing, verbose::Int64, status_exception::Bool})
Feb 14 07:01:14: │       @ HTTP.Connections /srv/nanosoldier/depot/packages/HTTP/ucRde/src/Connections.jl:520
Feb 14 07:01:14: │     [4] getconnection
Feb 14 07:01:14: │       @ /srv/nanosoldier/depot/packages/HTTP/ucRde/src/Connections.jl:508 [inlined]
Feb 14 07:01:14: │     [5] getconnection(::Type{OpenSSL.SSLStream}, host::SubString{String}, port::SubString{String}; kw::@Kwargs{require_ssl_verification::Bool, keepalive::Bool, readtimeout::Int64, iofunction::Nothing, decompress::Nothing, verbose::Int64, status_exception::Bool})
Feb 14 07:01:14: │       @ HTTP.Connections /srv/nanosoldier/depot/packages/HTTP/ucRde/src/Connections.jl:585
Feb 14 07:01:14: │     [6] getconnection
Feb 14 07:01:14: │       @ /srv/nanosoldier/depot/packages/HTTP/ucRde/src/Connections.jl:578 [inlined]
Feb 14 07:01:14: │     [7] #10
Feb 14 07:01:14: │       @ /srv/nanosoldier/depot/packages/HTTP/ucRde/src/Connections.jl:467 [inlined]
Feb 14 07:01:14: │     [8] macro expansion
Feb 14 07:01:14: │       @ /srv/nanosoldier/depot/packages/ConcurrentUtilities/QOkoO/src/try_with_timeout.jl:82 [inlined]
Feb 14 07:01:14: │     [9] (::ConcurrentUtilities.var"#2#4"{Any, Timer, ConcurrentUtilities.TimedOut{Any}, Channel{Any}, HTTP.Connections.var"#10#13"{OpenSSL.SSLStream, Bool, Bool, @Kwargs{readtimeout::Int64, iofunction::Nothing, decompress::Nothing, verbose::Int64, status_exception::Bool}, SubString{String}, SubStrin>
Feb 14 07:01:14: │       @ ConcurrentUtilities /srv/nanosoldier/depot/packages/ConcurrentUtilities/QOkoO/src/ConcurrentUtilities.jl:9
Feb 14 07:01:14: │    Stacktrace:
Feb 14 07:01:14: │      [1] (::HTTP.ConnectionRequest.var"#connections#4"{HTTP.ConnectionRequest.var"#connections#1#5"{HTTP.TimeoutRequest.var"#timeouts#3"{HTTP.TimeoutRequest.var"#timeouts#1#4"{HTTP.ExceptionRequest.var"#exceptions#2"{HTTP.ExceptionRequest.var"#exceptions#1#3"{typeof(HTTP.StreamRequest.streamlayer)}}>
Feb 14 07:01:14: │        @ HTTP.ConnectionRequest /srv/nanosoldier/depot/packages/HTTP/ucRde/src/clientlayers/ConnectionRequest.jl:88
Feb 14 07:01:14: │      [2] connections
Feb 14 07:01:14: │        @ /srv/nanosoldier/depot/packages/HTTP/ucRde/src/clientlayers/ConnectionRequest.jl:60 [inlined]
Feb 14 07:01:14: │      [3] (::Base.var"#96#98"{Base.var"#96#97#99"{ExponentialBackOff, HTTP.RetryRequest.var"#2#5"{Int64, typeof(HTTP.RetryRequest.FALSE), HTTP.Messages.Request, Base.RefValue{Int64}}, HTTP.ConnectionRequest.var"#connections#4"{HTTP.ConnectionRequest.var"#connections#1#5"{HTTP.TimeoutRequest.var"#time>
Feb 14 07:01:14: │        @ Base ./error.jl:296
Feb 14 07:01:14: │      [4] (::HTTP.RetryRequest.var"#manageretries#3"{HTTP.RetryRequest.var"#manageretries#1#4"{HTTP.ConnectionRequest.var"#connections#4"{HTTP.ConnectionRequest.var"#connections#1#5"{HTTP.TimeoutRequest.var"#timeouts#3"{HTTP.TimeoutRequest.var"#timeouts#1#4"{HTTP.ExceptionRequest.var"#exceptions#2"{H>
Feb 14 07:01:14: │        @ HTTP.RetryRequest /srv/nanosoldier/depot/packages/HTTP/ucRde/src/clientlayers/RetryRequest.jl:75
Feb 14 07:01:14: │      [5] manageretries
Feb 14 07:01:14: │        @ /srv/nanosoldier/depot/packages/HTTP/ucRde/src/clientlayers/RetryRequest.jl:30 [inlined]
Feb 14 07:01:14: │      [6] (::HTTP.CookieRequest.var"#managecookies#4"{HTTP.CookieRequest.var"#managecookies#1#5"{HTTP.RetryRequest.var"#manageretries#3"{HTTP.RetryRequest.var"#manageretries#1#4"{HTTP.ConnectionRequest.var"#connections#4"{HTTP.ConnectionRequest.var"#connections#1#5"{HTTP.TimeoutRequest.var"#timeouts#>
Feb 14 07:01:14: │        @ HTTP.CookieRequest /srv/nanosoldier/depot/packages/HTTP/ucRde/src/clientlayers/CookieRequest.jl:42
Feb 14 07:01:14: │      [7] managecookies
Feb 14 07:01:14: │        @ /srv/nanosoldier/depot/packages/HTTP/ucRde/src/clientlayers/CookieRequest.jl:19 [inlined]
Feb 14 07:01:14: │      [8] (::HTTP.HeadersRequest.var"#defaultheaders#2"{HTTP.HeadersRequest.var"#defaultheaders#1#3"{HTTP.CookieRequest.var"#managecookies#4"{HTTP.CookieRequest.var"#managecookies#1#5"{HTTP.RetryRequest.var"#manageretries#3"{HTTP.RetryRequest.var"#manageretries#1#4"{HTTP.ConnectionRequest.var"#connec>
Feb 14 07:01:14: │        @ HTTP.HeadersRequest /srv/nanosoldier/depot/packages/HTTP/ucRde/src/clientlayers/HeadersRequest.jl:71
Feb 14 07:01:14: │      [9] defaultheaders
Feb 14 07:01:14: │        @ /srv/nanosoldier/depot/packages/HTTP/ucRde/src/clientlayers/HeadersRequest.jl:14 [inlined]
Feb 14 07:01:14: │     [10] (::HTTP.RedirectRequest.var"#redirects#3"{HTTP.RedirectRequest.var"#redirects#1#4"{HTTP.HeadersRequest.var"#defaultheaders#2"{HTTP.HeadersRequest.var"#defaultheaders#1#3"{HTTP.CookieRequest.var"#managecookies#4"{HTTP.CookieRequest.var"#managecookies#1#5"{HTTP.RetryRequest.var"#manageretries>
Feb 14 07:01:14: │        @ HTTP.RedirectRequest /srv/nanosoldier/depot/packages/HTTP/ucRde/src/clientlayers/RedirectRequest.jl:25
Feb 14 07:01:14: │     [11] redirects
Feb 14 07:01:14: │        @ /srv/nanosoldier/depot/packages/HTTP/ucRde/src/clientlayers/RedirectRequest.jl:14 [inlined]
Feb 14 07:01:14: │     [12] (::HTTP.MessageRequest.var"#makerequest#3"{HTTP.MessageRequest.var"#makerequest#1#4"{HTTP.RedirectRequest.var"#redirects#3"{HTTP.RedirectRequest.var"#redirects#1#4"{HTTP.HeadersRequest.var"#defaultheaders#2"{HTTP.HeadersRequest.var"#defaultheaders#1#3"{HTTP.CookieRequest.var"#managecookies#>
Feb 14 07:01:14: │        @ HTTP.MessageRequest /srv/nanosoldier/depot/packages/HTTP/ucRde/src/clientlayers/MessageRequest.jl:35
Feb 14 07:01:14: │     [13] makerequest
Feb 14 07:01:14: │        @ /srv/nanosoldier/depot/packages/HTTP/ucRde/src/clientlayers/MessageRequest.jl:24 [inlined]
Feb 14 07:01:14: │     [14] request(stack::HTTP.MessageRequest.var"#makerequest#3"{HTTP.MessageRequest.var"#makerequest#1#4"{HTTP.RedirectRequest.var"#redirects#3"{HTTP.RedirectRequest.var"#redirects#1#4"{HTTP.HeadersRequest.var"#defaultheaders#2"{HTTP.HeadersRequest.var"#defaultheaders#1#3"{HTTP.CookieRequest.var"#ma>
Feb 14 07:01:14: │        @ HTTP /srv/nanosoldier/depot/packages/HTTP/ucRde/src/HTTP.jl:457
Feb 14 07:01:14: │     [15] #request#20
Feb 14 07:01:14: │        @ /srv/nanosoldier/depot/packages/HTTP/ucRde/src/HTTP.jl:315 [inlined]
Feb 14 07:01:14: │     [16] request
Feb 14 07:01:14: │        @ /srv/nanosoldier/depot/packages/HTTP/ucRde/src/HTTP.jl:313 [inlined]
Feb 14 07:01:14: │     [17] post
Feb 14 07:01:14: │        @ /srv/nanosoldier/depot/packages/HTTP/ucRde/src/HTTP.jl:532 [inlined]
Feb 14 07:01:14: │     [18] github_request(api::GitHub.GitHubWebAPI, request_method::typeof(HTTP.post), endpoint::String; auth::GitHub.OAuth2, handle_error::Bool, headers::Dict{Any, Any}, params::Dict{String, String}, allowredirects::Bool)
Feb 14 07:01:14: │        @ GitHub /srv/nanosoldier/depot/packages/GitHub/QSthy/src/utils/requests.jl:66
Feb 14 07:01:14: │     [19] github_request
Feb 14 07:01:14: │        @ /srv/nanosoldier/depot/packages/GitHub/QSthy/src/utils/requests.jl:55 [inlined]
Feb 14 07:01:14: │     [20] gh_post
Feb 14 07:01:14: │        @ /srv/nanosoldier/depot/packages/GitHub/QSthy/src/utils/requests.jl:73 [inlined]
Feb 14 07:01:14: │     [21] gh_post_json(api::GitHub.GitHubWebAPI, endpoint::String; options::@Kwargs{auth::GitHub.OAuth2, params::Dict{String, String}})
Feb 14 07:01:14: │        @ GitHub /srv/nanosoldier/depot/packages/GitHub/QSthy/src/utils/requests.jl:79
Feb 14 07:01:14: │     [22] gh_post_json
Feb 14 07:01:14: │        @ /srv/nanosoldier/depot/packages/GitHub/QSthy/src/utils/requests.jl:79 [inlined]
Feb 14 07:01:14: │     [23] create_comment(api::GitHub.GitHubWebAPI, repo::String, item::String, kind::Symbol; options::@Kwargs{auth::GitHub.OAuth2, params::Dict{String, String}})
Feb 14 07:01:14: │        @ GitHub /srv/nanosoldier/depot/packages/GitHub/QSthy/src/issues/comments.jl:71
Feb 14 07:01:14: │     [24] create_comment
Feb 14 07:01:14: │        @ /srv/nanosoldier/depot/packages/GitHub/QSthy/src/issues/comments.jl:61 [inlined]
Feb 14 07:01:14: │     [25] #create_comment#214
Feb 14 07:01:14: │        @ ./none:0 [inlined]
Feb 14 07:01:14: │     [26] reply_comment(sub::Nanosoldier.JobSubmission, message::String)
Feb 14 07:01:14: │        @ Nanosoldier /srv/nanosoldier/pkg/Nanosoldier/src/submission.jl:153
Feb 14 07:01:14: │     [27] delegate_job(server::Nanosoldier.Server, job::Nanosoldier.PkgEvalJob, node::Int64)
Feb 14 07:01:14: │        @ Nanosoldier /srv/nanosoldier/pkg/Nanosoldier/src/server.jl:141
Feb 14 07:01:14: │     [28] (::Nanosoldier.var"#89#90"{Nanosoldier.Server, DataType, Int64, Vector{Int64}})()
Feb 14 07:01:14: │        @ Nanosoldier /srv/nanosoldier/pkg/Nanosoldier/src/server.jl:93
Feb 14 07:01:14: └ @ Nanosoldier /srv/nanosoldier/pkg/Nanosoldier/src/config.jl:46
Feb 15 15:45:08: [ Info: [Node 1 | 2025-02-15T15:45:08.833]: considering job submission with phrase RegexMatch("@nanosoldier `runtests([\"SIMDTypes\", \"RiemannComplexNumbers\", \"MistyClosures\", \"LazyBroadcast\", \"SyntaxTree\", \"DontMaterialize\", \"Fuzzy\", \"TypeTree\", \"TraceFuns\", \"ProtoStructs\", \"Bits\">

maleadt avatar Feb 17 '25 08:02 maleadt