akka icon indicating copy to clipboard operation
akka copied to clipboard

failed: OutboundIdleShutdownSpec

Open patriknw opened this issue 3 years ago • 36 comments

multi-node with aeron-udp

https://github.com/akka/akka/runs/4500485510?check_suite_focus=true

2021-12-13T02:04:12.0455829Z [info]   The future returned an exception of type: akka.actor.ActorNotFound, with message: Actor not found for: ActorSelection[Anchor(akka://OutboundIdleShutdownSpec-remote-4@localhost:42137/), Path(/user/echo)]. (OutboundIdleShutdownSpec.scala:198)
2021-12-13T02:04:12.0461246Z [info]   org.scalatest.exceptions.TestFailedException:
2021-12-13T02:04:12.0466128Z [info]   at org.scalatest.concurrent.ScalaFutures$$anon$1.futureValueImpl(ScalaFutures.scala:333)
2021-12-13T02:04:12.0470696Z [info]   at org.scalatest.concurrent.Futures$FutureConcept.futureValue(Futures.scala:476)
2021-12-13T02:04:12.0475510Z [info]   at org.scalatest.concurrent.Futures$FutureConcept.futureValue$(Futures.scala:475)
2021-12-13T02:04:12.0482611Z [info]   at org.scalatest.concurrent.ScalaFutures$$anon$1.futureValue(ScalaFutures.scala:281)
2021-12-13T02:04:12.0485677Z [info]   at akka.remote.artery.OutboundIdleShutdownSpec.withAssociation$1(OutboundIdleShutdownSpec.scala:198)
2021-12-13T02:04:12.0488597Z [info]   at akka.remote.artery.OutboundIdleShutdownSpec.$anonfun$new$20(OutboundIdleShutdownSpec.scala:141)

patriknw avatar Dec 13 '21 07:12 patriknw

https://github.com/akka/akka/runs/4495316564?check_suite_focus=true

patriknw avatar Dec 13 '21 07:12 patriknw

https://github.com/akka/akka/runs/4554855749?check_suite_focus=true

patriknw avatar Dec 17 '21 08:12 patriknw

In Aeron multi-node: https://github.com/akka/akka/runs/5297795403?check_suite_focus=true

2022-02-23T04:10:49.5699744Z [INFO] [02/23/2022 04:10:49.569] [pool-1-thread-1] [ArteryTransport(akka://OutboundIdleShutdownSpec)] Started embedded media driver in directory [/opt/volumes/media-driver/OutboundIdleShutdownSpec-6f396db2-27f9-4dda-a2fa-2e9bf75c76e4]
2022-02-23T04:10:49.5824043Z [INFO] [02/23/2022 04:10:49.581] [pool-1-thread-1] [ArteryTransport(akka://OutboundIdleShutdownSpec)] Remoting started with transport [Artery aeron-udp]; listening on address [akka://OutboundIdleShutdownSpec@localhost:40621] with UID [-1581809473256921188]
2022-02-23T04:10:49.6142936Z [0m[[0m[0minfo[0m] [0m[0m[32mOutboundIdleShutdownSpec:[0m[0m
2022-02-23T04:10:49.6148475Z Coroner Thread Count starts at 93 in akka.remote.artery.OutboundIdleShutdownSpec
2022-02-23T04:10:49.6157451Z [0m[[0m[0minfo[0m] [0m[0m[32mOutbound streams[0m[0m
2022-02-23T04:10:49.6397800Z [WARN] [02/23/2022 04:10:49.639] [pool-1-thread-1-ScalaTest-running-OutboundIdleShutdownSpec] [akka.actor.ActorSystemImpl(OutboundIdleShutdownSpec-remote-0)] Failed to load JFR flight recorder, falling back to noop. Exception: java.lang.ClassNotFoundException: akka.remote.artery.jfr.JFRRemotingFlightRecorder
2022-02-23T04:10:49.6404184Z [WARN] [02/23/2022 04:10:49.639] [pool-1-thread-1-ScalaTest-running-OutboundIdleShutdownSpec] [akka.remote.RemoteActorRefProvider] Akka Cluster not in use - Using Akka Cluster is recommended if you need remote watch and deploy.
2022-02-23T04:10:49.6671234Z [INFO] [02/23/2022 04:10:49.666] [pool-1-thread-1-ScalaTest-running-OutboundIdleShutdownSpec] [ArteryTransport(akka://OutboundIdleShutdownSpec-remote-0)] Started embedded media driver in directory [/opt/volumes/media-driver/OutboundIdleShutdownSpec-remote-0-6d238e3d-9fbd-413f-afa1-0f9d9acbd985]
2022-02-23T04:10:49.6856710Z [INFO] [02/23/2022 04:10:49.684] [pool-1-thread-1-ScalaTest-running-OutboundIdleShutdownSpec] [ArteryTransport(akka://OutboundIdleShutdownSpec-remote-0)] Remoting started with transport [Artery aeron-udp]; listening on address [akka://OutboundIdleShutdownSpec-remote-0@localhost:40511] with UID [-6342214471546211483]
2022-02-23T04:10:52.9901700Z [INFO] [02/23/2022 04:10:52.987] [pool-1-thread-1-ScalaTest-running-OutboundIdleShutdownSpec] [CoordinatedShutdown(akka://OutboundIdleShutdownSpec-remote-0)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
2022-02-23T04:10:53.0266503Z [INFO] [02/23/2022 04:10:52.990] [OutboundIdleShutdownSpec-remote-0-akka.remote.default-remote-dispatcher-12] [akka://OutboundIdleShutdownSpec-remote-0@localhost:40511/system/remoting-terminator] Shutting down remote daemon.
2022-02-23T04:10:53.0269096Z [INFO] [02/23/2022 04:10:52.990] [OutboundIdleShutdownSpec-remote-0-akka.remote.default-remote-dispatcher-12] [akka://OutboundIdleShutdownSpec-remote-0@localhost:40511/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports.
2022-02-23T04:10:53.0415860Z [WARN] [02/23/2022 04:10:53.041] [OutboundIdleShutdownSpec-akka.actor.default-dispatcher-13] [akka://OutboundIdleShutdownSpec/temp/_user_echo$a] received dead letter: ActorIdentity(None,Some(Actor[akka://OutboundIdleShutdownSpec-remote-0@localhost:40511/user/echo#-393299597]))
2022-02-23T04:10:53.0418883Z [INFO] [akkaDeadLetter][02/23/2022 04:10:53.029] [OutboundIdleShutdownSpec-akka.actor.default-dispatcher-6] [akka://OutboundIdleShutdownSpec/temp/_user_echo$a] Message [akka.actor.ActorIdentity] to Actor[akka://OutboundIdleShutdownSpec/temp/_user_echo$a] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://OutboundIdleShutdownSpec/temp/_user_echo$a] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
2022-02-23T04:10:53.0458824Z [INFO] [02/23/2022 04:10:53.045] [OutboundIdleShutdownSpec-remote-0-akka.actor.internal-dispatcher-3] [ArteryTransport(akka://OutboundIdleShutdownSpec-remote-0)] Stopping embedded media driver in directory [/opt/volumes/media-driver/OutboundIdleShutdownSpec-remote-0-6d238e3d-9fbd-413f-afa1-0f9d9acbd985]
2022-02-23T04:10:53.1704358Z [INFO] [02/23/2022 04:10:53.169] [OutboundIdleShutdownSpec-remote-0-akka.remote.default-remote-dispatcher-7] [akka://OutboundIdleShutdownSpec-remote-0@localhost:40511/system/remoting-terminator] Remoting shut down.
2022-02-23T04:10:53.2618309Z [0m[[0m[0minfo[0m] [0m[0m[31m- should be stopped when they are idle *** FAILED *** (3 seconds, 612 milliseconds)[0m[0m
2022-02-23T04:10:53.2620129Z [0m[[0m[0minfo[0m] [0m[0m[31m  The future returned an exception of type: akka.actor.ActorNotFound, with message: Actor not found for: ActorSelection[Anchor(akka://OutboundIdleShutdownSpec-remote-0@localhost:40511/), Path(/user/echo)]. (OutboundIdleShutdownSpec.scala:198)[0m[0m
2022-02-23T04:10:53.2624181Z [0m[[0m[0minfo[0m] [0m[0m[31m  org.scalatest.exceptions.TestFailedException:[0m[0m
2022-02-23T04:10:53.2625427Z [0m[[0m[0minfo[0m] [0m[0m[31m  at org.scalatest.concurrent.ScalaFutures$$anon$1.futureValueImpl(ScalaFutures.scala:333)[0m[0m
2022-02-23T04:10:53.2627094Z [0m[[0m[0minfo[0m] [0m[0m[31m  at org.scalatest.concurrent.Futures$FutureConcept.futureValue(Futures.scala:476)[0m[0m
2022-02-23T04:10:53.2629205Z [0m[[0m[0minfo[0m] [0m[0m[31m  at org.scalatest.concurrent.Futures$FutureConcept.futureValue$(Futures.scala:475)[0m[0m
2022-02-23T04:10:53.2631654Z [0m[[0m[0minfo[0m] [0m[0m[31m  at org.scalatest.concurrent.ScalaFutures$$anon$1.futureValue(ScalaFutures.scala:281)[0m[0m
2022-02-23T04:10:53.2769126Z [0m[[0m[0minfo[0m] [0m[0m[31m  at akka.remote.artery.OutboundIdleShutdownSpec.withAssociation$1(OutboundIdleShutdownSpec.scala:198)[0m[0m
2022-02-23T04:10:53.2773665Z [0m[[0m[0minfo[0m] [0m[0m[31m  at akka.remote.artery.OutboundIdleShutdownSpec.$anonfun$new$2(OutboundIdleShutdownSpec.scala:64)[0m[0m

patriknw avatar Mar 08 '22 11:03 patriknw

If this fails again we can switch to retry as discussed in PR

patriknw avatar Mar 08 '22 15:03 patriknw

Failed in https://github.com/akka/akka/runs/5802653929?check_suite_focus=true#step:5:2275

pvlugter avatar Apr 04 '22 01:04 pvlugter

https://github.com/akka/akka/runs/6890950812?check_suite_focus=true

raboof avatar Jun 16 '22 07:06 raboof

https://github.com/akka/akka/runs/6951601688?check_suite_focus=true#step:5:2224

pvlugter avatar Jun 20 '22 23:06 pvlugter

https://github.com/akka/akka/runs/6995218784?check_suite_focus=true#step:5:2351

johanandren avatar Jun 22 '22 10:06 johanandren

https://github.com/akka/akka/runs/7224937888?check_suite_focus=true

raboof avatar Jul 07 '22 09:07 raboof

https://github.com/akka/akka/runs/7331485740?check_suite_focus=true#step:5:2434

pvlugter avatar Jul 17 '22 23:07 pvlugter

https://github.com/akka/akka/runs/7708433816?check_suite_focus=true#step:5:2784

pvlugter avatar Aug 07 '22 23:08 pvlugter

https://github.com/akka/akka/runs/8046410206?check_suite_focus=true#step:5:2372

octonato avatar Aug 29 '22 08:08 octonato

https://github.com/akka/akka/runs/8165683316?check_suite_focus=true#step:5:2229

pvlugter avatar Sep 05 '22 00:09 pvlugter

https://github.com/akka/akka/runs/8172943395?check_suite_focus=true#step:5:2358

pvlugter avatar Sep 05 '22 00:09 pvlugter

https://github.com/akka/akka/runs/8239618394?check_suite_focus=true#step:5:2396

pvlugter avatar Sep 11 '22 23:09 pvlugter

https://github.com/akka/akka/actions/runs/3056918371/jobs/4931539053

johanandren avatar Sep 15 '22 07:09 johanandren

https://github.com/akka/akka/actions/runs/3124231250/jobs/5067396421#step:5:2386

octonato avatar Sep 26 '22 12:09 octonato

https://github.com/akka/akka/actions/runs/3139903168/jobs/5100752068#step:5:2271

johanandren avatar Sep 28 '22 11:09 johanandren

https://github.com/akka/akka/actions/runs/3170648683/jobs/5163372446#step:5:2128

pvlugter avatar Oct 03 '22 02:10 pvlugter

https://github.com/akka/akka/actions/runs/3178443393/jobs/5179936204#step:5:2285

johanandren avatar Oct 05 '22 11:10 johanandren

https://github.com/akka/akka/actions/runs/3193592614/jobs/5212304332#step:5:2274

patriknw avatar Oct 07 '22 08:10 patriknw

https://github.com/akka/akka/actions/runs/3201361974/jobs/5229253627#step:5:2301

patriknw avatar Oct 07 '22 08:10 patriknw

https://github.com/akka/akka/actions/runs/3246562917/jobs/5325442015#step:5:2205

patriknw avatar Oct 14 '22 12:10 patriknw

https://github.com/akka/akka/actions/runs/3261479772/jobs/5356458261#step:5:2430

pvlugter avatar Oct 17 '22 03:10 pvlugter

https://github.com/akka/akka/actions/runs/3277859636/jobs/5395610387#step:5:2223

patriknw avatar Oct 19 '22 06:10 patriknw

https://github.com/akka/akka/actions/runs/3333504126/jobs/5515491830#step:5:2183

patriknw avatar Oct 27 '22 07:10 patriknw

https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2267

[info] - should remove inbound compression after restart with same host:port *** FAILED *** (2 seconds, 796 milliseconds)
[2267](https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2268)
[info]   The future returned an exception of type: akka.actor.ActorNotFound, with message: Actor not found for: ActorSelection[Anchor(akka://OutboundIdleShutdownSpec-remote-4@localhost:44142/), Path(/user/echo)]. (OutboundIdleShutdownSpec.scala:200)
[2268](https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2269)
[info]   org.scalatest.exceptions.TestFailedException:
[2269](https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2270)
[info]   at org.scalatest.concurrent.ScalaFutures$$anon$1.futureValueImpl(ScalaFutures.scala:333)
[2270](https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2271)
[info]   at org.scalatest.concurrent.Futures$FutureConcept.futureValue(Futures.scala:476)
[2271](https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2272)
[info]   at org.scalatest.concurrent.Futures$FutureConcept.futureValue$(Futures.scala:475)
[2272](https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2273)
[info]   at org.scalatest.concurrent.ScalaFutures$$anon$1.futureValue(ScalaFutures.scala:281)
[2273](https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2274)
[info]   at akka.remote.artery.OutboundIdleShutdownSpec.withAssociation$1(OutboundIdleShutdownSpec.scala:200)
[2274](https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2275)
[info]   at akka.remote.artery.OutboundIdleShutdownSpec.$anonfun$new$20(OutboundIdleShutdownSpec.scala:142)
[2275](https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2276)
[info]   at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18)
[2276](https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2277)
[info]   at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85)
[2277](https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2278)
[info]   at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83)
[2278](https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2279)
[info]   at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
[2279](https://github.com/akka/akka/actions/runs/3424254041/jobs/5703719021#step:5:2280)
[info]   at org.scalatest.Transformer.apply(Transformer.scala:22)

johanandren avatar Nov 09 '22 19:11 johanandren

https://github.com/akka/akka/actions/runs/3441439293/jobs/5740977407#step:5:2230

patriknw avatar Nov 11 '22 15:11 patriknw

https://github.com/akka/akka/actions/runs/3453087566/jobs/5763405183#step:5:2871

pvlugter avatar Nov 13 '22 23:11 pvlugter

https://github.com/akka/akka/actions/runs/3501155899/jobs/5864511602#step:5:2533

[info] - should still be resumable after they have been stopped *** FAILED *** (19 seconds, 872 milliseconds)
[info]   The future returned an exception of type: akka.actor.ActorNotFound, with message: Actor not found for: ActorSelection[Anchor(akka://OutboundIdleShutdownSpec-remote-1@localhost:58332/), Path(/user/echo)]. (OutboundIdleShutdownSpec.scala:200)
[info]   org.scalatest.exceptions.TestFailedException:
[info]   at org.scalatest.concurrent.ScalaFutures$$anon$1.futureValueImpl(ScalaFutures.scala:333)
[info]   at org.scalatest.concurrent.Futures$FutureConcept.futureValue(Futures.scala:476)
[info]   at org.scalatest.concurrent.Futures$FutureConcept.futureValue$(Futures.scala:475)
[info]   at org.scalatest.concurrent.ScalaFutures$$anon$1.futureValue(ScalaFutures.scala:281)
[info]   at akka.remote.artery.OutboundIdleShutdownSpec.withAssociation$1(OutboundIdleShutdownSpec.scala:200)
[info]   at akka.remote.artery.OutboundIdleShutdownSpec.$anonfun$new$6(OutboundIdleShutdownSpec.scala:79)

pvlugter avatar Nov 21 '22 00:11 pvlugter