Flaky test: Aspire.Hosting.Tests.DistributedApplicationTests.StartAsync_UnsecuredAllowAnonymous_PassedToDashboardProcess
Build Information
Build: https://github.com/dotnet/aspire/actions/runs/14395105275 Build error leg or test failing: Aspire.Hosting.Tests.DistributedApplicationTests.StartAsync_UnsecuredAllowAnonymous_PassedToDashboardProcess Pull request:
Error Message
Fill the error message using step by step known issues guidance.
{
"ErrorMessage": "",
"ErrorPattern": "",
"BuildRetry": false,
"ExcludeConsoleLog": false
}
System.TimeoutException : The operation at /_/tests/Aspire.Hosting.Tests/DistributedApplicationTests.cs:686 timed out after reaching the limit of 30000ms. at Microsoft.AspNetCore.InternalTesting.AsyncTestHelpers.TimeoutAfter(Task task, TimeSpan timeout, String filePath, Int32 lineNumber) in /_/tests/Shared/AsyncTestHelpers.cs:line 177
at Aspire.Hosting.Tests.DistributedApplicationTests.StartAsync_UnsecuredAllowAnonymous_PassedToDashboardProcess() in /_/tests/Aspire.Hosting.Tests/DistributedApplicationTests.cs:line 686
at Aspire.Hosting.Tests.DistributedApplicationTests.StartAsync_UnsecuredAllowAnonymous_PassedToDashboardProcess() in /_/tests/Aspire.Hosting.Tests/DistributedApplicationTests.cs:line 695
--- End of stack trace from previous location ---
Stdout
Stdout
| [2025-04-11T03:51:26] Grpc.AspNetCore.Server.Model.Internal.ServiceRouteBuilder Trace: Discovering gRPC methods for Aspire.Hosting.Dashboard.DashboardService.
| [2025-04-11T03:51:26] Grpc.AspNetCore.Server.Model.Internal.ServiceRouteBuilder Trace: Added gRPC method 'GetApplicationInformation' to service 'aspire.v1.DashboardService'. Method type: Unary, HTTP method: POST, route pattern: '/aspire.v1.DashboardService/GetApplicationInformation'.
| [2025-04-11T03:51:26] Grpc.AspNetCore.Server.Model.Internal.ServiceRouteBuilder Trace: Added gRPC method 'WatchResources' to service 'aspire.v1.DashboardService'. Method type: ServerStreaming, HTTP method: POST, route pattern: '/aspire.v1.DashboardService/WatchResources'.
| [2025-04-11T03:51:26] Grpc.AspNetCore.Server.Model.Internal.ServiceRouteBuilder Trace: Added gRPC method 'WatchResourceConsoleLogs' to service 'aspire.v1.DashboardService'. Method type: ServerStreaming, HTTP method: POST, route pattern: '/aspire.v1.DashboardService/WatchResourceConsoleLogs'.
| [2025-04-11T03:51:26] Grpc.AspNetCore.Server.Model.Internal.ServiceRouteBuilder Trace: Added gRPC method 'ExecuteResourceCommand' to service 'aspire.v1.DashboardService'. Method type: Unary, HTTP method: POST, route pattern: '/aspire.v1.DashboardService/ExecuteResourceCommand'.
| [2025-04-11T03:51:26] Microsoft.Extensions.Hosting.Internal.Host Debug: Hosting starting
| [2025-04-11T03:51:26] Aspire.Hosting.DistributedApplication Information: Aspire version: 9.3.0-ci
| [2025-04-11T03:51:26] Aspire.Hosting.DistributedApplication Information: Distributed application starting.
| [2025-04-11T03:51:26] Aspire.Hosting.DistributedApplication Information: Application host directory is: D:\a\aspire\aspire\tests\Aspire.Hosting.Tests
| [2025-04-11T03:51:26] Aspire.Hosting.Cli.BackchannelService Debug: Backchannel socket path was not specified.
| [2025-04-11T03:51:26] Microsoft.Extensions.Hosting.Internal.Host Debug: Hosting starting
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager Information: User profile is available. Using 'C:\Users\runneradmin\AppData\Local\ASP.NET\DataProtection-Keys' as key repository and Windows DPAPI to encrypt keys at rest.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.KeyManagement.DefaultKeyResolver Debug: Repository contains no viable default key. Caller should generate a key with immediate activation.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.KeyManagement.KeyRingProvider Debug: Policy resolution states that a new key should be added to the key ring.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager Information: Creating key {3ee4a291-72ec-4798-81c0-30b2d1f4c552} with creation date 2025-04-11 03:51:26Z, activation date 2025-04-11 03:51:26Z, and expiration date 2025-07-10 03:51:26Z.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager Debug: Descriptor deserializer type for key {3ee4a291-72ec-4798-81c0-30b2d1f4c552} is 'Microsoft.AspNetCore.DataProtection.AuthenticatedEncryption.ConfigurationModel.AuthenticatedEncryptorDescriptorDeserializer, Microsoft.AspNetCore.DataProtection, Version=8.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60'.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager Debug: No key escrow sink found. Not writing key {3ee4a291-72ec-4798-81c0-30b2d1f4c552} to escrow.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.XmlEncryption.DpapiXmlEncryptor Debug: Encrypting to Windows DPAPI for current user account (fv-az1760-266\runneradmin).
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.Repositories.FileSystemXmlRepository Information: Writing data to file 'C:\Users\runneradmin\AppData\Local\ASP.NET\DataProtection-Keys\key-3ee4a291-72ec-4798-81c0-30b2d1f4c552.xml'.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager Debug: Key cache expiration token triggered by 'CreateNewKey' operation.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.Repositories.FileSystemXmlRepository Debug: Reading data from file 'C:\Users\runneradmin\AppData\Local\ASP.NET\DataProtection-Keys\key-3ee4a291-72ec-4798-81c0-30b2d1f4c552.xml'.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager Debug: Found key {3ee4a291-72ec-4798-81c0-30b2d1f4c552}.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.KeyManagement.DefaultKeyResolver Debug: Considering key {3ee4a291-72ec-4798-81c0-30b2d1f4c552} with expiration date 2025-07-10 03:51:26Z as default key.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.TypeForwardingActivator Debug: Forwarded activator type request from Microsoft.AspNetCore.DataProtection.XmlEncryption.DpapiXmlDecryptor, Microsoft.AspNetCore.DataProtection, Version=8.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60 to Microsoft.AspNetCore.DataProtection.XmlEncryption.DpapiXmlDecryptor, Microsoft.AspNetCore.DataProtection, Culture=neutral, PublicKeyToken=adb9793829ddae60
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.XmlEncryption.DpapiXmlDecryptor Debug: Decrypting secret element using Windows DPAPI.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.TypeForwardingActivator Debug: Forwarded activator type request from Microsoft.AspNetCore.DataProtection.AuthenticatedEncryption.ConfigurationModel.AuthenticatedEncryptorDescriptorDeserializer, Microsoft.AspNetCore.DataProtection, Version=8.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60 to Microsoft.AspNetCore.DataProtection.AuthenticatedEncryption.ConfigurationModel.AuthenticatedEncryptorDescriptorDeserializer, Microsoft.AspNetCore.DataProtection, Culture=neutral, PublicKeyToken=adb9793829ddae60
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.AuthenticatedEncryption.CngCbcAuthenticatedEncryptorFactory Debug: Opening CNG algorithm 'AES' from provider '(null)' with chaining mode CBC.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.AuthenticatedEncryption.CngCbcAuthenticatedEncryptorFactory Debug: Opening CNG algorithm 'SHA256' from provider '(null)' with HMAC.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.KeyManagement.KeyRingProvider Debug: Using key {3ee4a291-72ec-4798-81c0-30b2d1f4c552} as the default key.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.DataProtection.Internal.DataProtectionHostedService Debug: Key ring with default key {3ee4a291-72ec-4798-81c0-30b2d1f4c552} was loaded during application startup.
| [2025-04-11T03:51:26] Microsoft.AspNetCore.Hosting.Diagnostics Debug: Loaded hosting startup assembly Aspire.Hosting.Tests
| [2025-04-11T03:51:26] Microsoft.Extensions.Hosting.Internal.Host Debug: Hosting started
| [2025-04-11T03:51:46] Aspire.Hosting.Dcp.DcpHost Information: Starting DCP with arguments: start-apiserver --monitor 6984 --detach --kubeconfig "C:\Users\runneradmin\AppData\Local\Temp\aspire.s03j0x5m.rrx\kubeconfig"
| [2025-04-11T03:51:47] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 1
| Resource aspire-dashboard/aspire-dashboard-vrpdwdtd-1ceb7dd5 update published:
| ResourceType = Executable,
| CreationTimeStamp = (null),
| State = { Text = Hidden, Style = (null) },
| HeathStatus = (null),
| ResourceReady = False,
| ExitCode = (null),
| Urls = { },
| EnvironmentVariables = {
| },
| Properties = {
| },
| HealthReports = {
| },
| Commands = {
| }
| [2025-04-11T03:51:47] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 1
| Resource dashboard-allow-anonymous-servicea/dashboard-allow-anonymous-servicea-wqyhuvhz-1ceb7dd5 update published:
| ResourceType = ProjectResource,
| CreationTimeStamp = (null),
| State = { Text = (null), Style = (null) },
| HeathStatus = (null),
| ResourceReady = False,
| ExitCode = (null),
| Urls = { },
| EnvironmentVariables = {
| },
| Properties = {
| },
| HealthReports = {
| },
| Commands = {
| Start (resource-start) = Hidden
| Stop (resource-stop) = Hidden
| Restart (resource-restart) = Disabled
| }
| [2025-04-11T03:51:47] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 1
| Resource dashboard-allow-anonymous-serviceb/dashboard-allow-anonymous-serviceb-fwvgwrgg-1ceb7dd5 update published:
| ResourceType = ProjectResource,
| CreationTimeStamp = (null),
| State = { Text = (null), Style = (null) },
| HeathStatus = (null),
| ResourceReady = False,
| ExitCode = (null),
| Urls = { },
| EnvironmentVariables = {
| },
| Properties = {
| },
| HealthReports = {
| },
| Commands = {
| Start (resource-start) = Hidden
| Stop (resource-stop) = Hidden
| Restart (resource-restart) = Disabled
| }
| [2025-04-11T03:51:47] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 1
| Resource dashboard-allow-anonymous-servicec/dashboard-allow-anonymous-servicec-pmzrtqbm-1ceb7dd5 update published:
| ResourceType = ProjectResource,
| CreationTimeStamp = (null),
| State = { Text = (null), Style = (null) },
| HeathStatus = (null),
| ResourceReady = False,
| ExitCode = (null),
| Urls = { },
| EnvironmentVariables = {
| },
| Properties = {
| },
| HealthReports = {
| },
| Commands = {
| Start (resource-start) = Hidden
| Stop (resource-stop) = Hidden
| Restart (resource-restart) = Disabled
| }
| [2025-04-11T03:51:47] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 1
| Resource dashboard-allow-anonymous-workera/dashboard-allow-anonymous-workera-djyvnjhf-1ceb7dd5 update published:
| ResourceType = ProjectResource,
| CreationTimeStamp = (null),
| State = { Text = (null), Style = (null) },
| HeathStatus = (null),
| ResourceReady = False,
| ExitCode = (null),
| Urls = { },
| EnvironmentVariables = {
| },
| Properties = {
| },
| HealthReports = {
| },
| Commands = {
| Start (resource-start) = Hidden
| Stop (resource-stop) = Hidden
| Restart (resource-restart) = Disabled
| }
| [2025-04-11T03:51:47] Aspire.Hosting.Dcp.DcpExecutor Debug: Watching over DCP Executable resources.
| [2025-04-11T03:51:47] Aspire.Hosting.Dcp.DcpExecutor Debug: Watching over DCP Endpoint resources.
| [2025-04-11T03:51:47] Aspire.Hosting.Dcp.DcpExecutor Debug: Watching over DCP Container resources.
| [2025-04-11T03:51:47] Aspire.Hosting.Dcp.DcpExecutor Debug: Watching over DCP Service resources.
| [2025-04-11T03:51:48] Aspire.Hosting.Dcp.dcp.start-apiserver.api-server Information: Starting API server...
| [2025-04-11T03:51:48] Aspire.Hosting.Dcp.dcp.start-apiserver.api-server Information: API server started {"Address": "::1", "Port": 56084}
| [2025-04-11T03:51:48] Aspire.Hosting.Dcp.dcp.start-apiserver.dcp-host Information: Starting DCP controller host
| [2025-04-11T03:51:48] Aspire.Hosting.Dcp.dcp.start-apiserver.dcp-host Information: Started all services {"count": 1}
| [2025-04-11T03:51:48] Aspire.Hosting.Dcp.dcpctrl.ContainerOrchestrator Information: runtime status {"ContainerRuntime": "", "runtime": "podman", "status": {"Installed":false,"Running":false,"Error":"exec: \"podman\": executable file not found in %PATH%\nfailed to start podman command 'Info'"}}
| [2025-04-11T03:51:48] Aspire.Hosting.Dcp.KubernetesService Debug: Successfully read Kubernetes configuration from 'C:\Users\runneradmin\AppData\Local\Temp\aspire.s03j0x5m.rrx\kubeconfig' after 1711 milliseconds.
| [2025-04-11T03:51:56] Aspire.Hosting.Dcp.DcpExecutor Debug: Cancellation received while watching Service resources.
| [2025-04-11T03:51:56] Aspire.Hosting.Dcp.DcpExecutor Debug: Stopped watching Service resources.
| [2025-04-11T03:51:56] Aspire.Hosting.Dcp.DcpExecutor Debug: Cancellation received while watching Endpoint resources.
| [2025-04-11T03:51:56] Aspire.Hosting.Dcp.DcpExecutor Debug: Stopped watching Endpoint resources.
| [2025-04-11T03:51:56] Aspire.Hosting.Dcp.DcpExecutor Debug: Cancellation received while watching Executable resources.
| [2025-04-11T03:51:56] Aspire.Hosting.Dcp.DcpExecutor Debug: Stopped watching Executable resources.
| [2025-04-11T03:51:56] Aspire.Hosting.Dcp.DcpExecutor Debug: Cancellation received while watching Container resources.
| [2025-04-11T03:51:56] Aspire.Hosting.Dcp.DcpExecutor Debug: Stopped watching Container resources.
| [2025-04-11T03:51:56] Aspire.Hosting.Dcp.dcp.start-apiserver.api-server.adminHttpHandler Information: API server changed status {"OldStatus": "Running", "NewStatus": "CleaningResources"}
| [2025-04-11T03:51:57] Aspire.Hosting.Dcp.dcp.start-apiserver.api-server.adminHttpHandler Information: API server changed status {"OldStatus": "CleanupComplete", "NewStatus": "Stopping"}
| [2025-04-11T03:51:57] Aspire.Hosting.Dcp.dcp.start-apiserver Information: Shutting down...
| [2025-04-11T03:51:57] Aspire.Hosting.Dcp.dcp.start-apiserver.dcp-host Information: Service DCP controller host terminated gracefully
| [2025-04-11T03:51:57] Aspire.Hosting.Dcp.dcp.start-apiserver Information: Shutdown complete.
| [2025-04-11T03:51:57] Aspire.Hosting.Dcp.DcpExecutor Debug: Watching for service port allocation ended with an error after 8602.4686 (iteration 0)
| System.IO.IOException: The request was aborted.
| ---> System.IO.IOException: Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host..
| ---> System.Net.Sockets.SocketException (10054): An existing connection was forcibly closed by the remote host.
| --- End of inner exception stack trace ---
| at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
| at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
| at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken, Int32 estimatedSize)
| at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
| at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken)
| at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
| at System.Net.Http.Http2Connection.ProcessIncomingFramesAsync()
| --- End of inner exception stack trace ---
| at System.Net.Http.Http2Connection.ThrowRequestAborted(Exception innerException)
| at System.Net.Http.Http2Connection.Http2Stream.CheckResponseBodyState()
| at System.Net.Http.Http2Connection.Http2Stream.TryReadFromBuffer(Span`1 buffer, Boolean partOfSyncRead)
| at System.Net.Http.Http2Connection.Http2Stream.ReadDataAsync(Memory`1 buffer, HttpResponseMessage responseMessage, CancellationToken cancellationToken)
| at k8s.LineSeparatedHttpContent.CancelableStream.ReadAsync(Byte[] buffer, Int32 offset, Int32 count, CancellationToken cancellationToken)
| at System.IO.StreamReader.ReadBufferAsync(CancellationToken cancellationToken)
| at System.IO.StreamReader.ReadLineAsyncInternal(CancellationToken cancellationToken)
| at k8s.Watcher`1.<>c.<CreateWatchEventEnumerator>b__21_1[TR](Task`1 t)
| at System.Threading.Tasks.ContinuationResultTaskFromResultTask`2.InnerInvoke()
| at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)
| --- End of stack trace from previous location ---
| at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)
| at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot, Thread threadPoolThread)
| --- End of stack trace from previous location ---
| at k8s.Watcher`1.CreateWatchEventEnumerator(Func`1 streamReaderCreator, Action`1 onError, CancellationToken cancellationToken)+MoveNext()
| at k8s.Watcher`1.CreateWatchEventEnumerator(Func`1 streamReaderCreator, Action`1 onError, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
| at Aspire.Hosting.Utils.PeriodicRestartAsyncEnumerable.CreateAsync[T](Func`3 enumerableFactory, TimeSpan restartInterval, CancellationToken cancellationToken)+MoveNext() in /_/src/Aspire.Hosting/Utils/PeriodicRestartAsyncEnumerable.cs:line 39
| at Aspire.Hosting.Utils.PeriodicRestartAsyncEnumerable.CreateAsync[T](Func`3 enumerableFactory, TimeSpan restartInterval, CancellationToken cancellationToken)+MoveNext() in /_/src/Aspire.Hosting/Utils/PeriodicRestartAsyncEnumerable.cs:line 59
| at Aspire.Hosting.Utils.PeriodicRestartAsyncEnumerable.CreateAsync[T](Func`3 enumerableFactory, TimeSpan restartInterval, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
| at Aspire.Hosting.Dcp.KubernetesService.WatchAsync[T](String namespaceParameter, CancellationToken cancellationToken)+MoveNext() in /_/src/Aspire.Hosting/Dcp/KubernetesService.cs:line 275
| at Aspire.Hosting.Dcp.KubernetesService.WatchAsync[T](String namespaceParameter, CancellationToken cancellationToken)+MoveNext() in /_/src/Aspire.Hosting/Dcp/KubernetesService.cs:line 275
| at Aspire.Hosting.Dcp.KubernetesService.WatchAsync[T](String namespaceParameter, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
| at Aspire.Hosting.Dcp.DcpExecutor.<>c__DisplayClass52_0.<<CreateServicesAsync>b__1>d.MoveNext() in /_/src/Aspire.Hosting/Dcp/DcpExecutor.cs:line 601
| --- End of stack trace from previous location ---
| at Aspire.Hosting.Dcp.DcpExecutor.<>c__DisplayClass52_0.<<CreateServicesAsync>b__1>d.MoveNext() in /_/src/Aspire.Hosting/Dcp/DcpExecutor.cs:line 601
| --- End of stack trace from previous location ---
| at Polly.ResiliencePipeline.<>c.<<ExecuteAsync>b__3_0>d.MoveNext()
Last 10 failures:
-- Updated on 4/29/2025 6:21:23 PM UTC
Summary
| Last 40 | Total failed / total runs |
|---|---|
| 13 | 61 / 200 |
From the .trx file - Watching for service port allocation ended with an error after 9613.1847:
| [2025-04-29T16:15:44] Aspire.Hosting.Dcp.DcpExecutor Debug: Watching for service port allocation ended with an error after 9613.1847 (iteration 0)
| System.IO.IOException: The request was aborted.
| ---> System.IO.IOException: Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host..
| ---> System.Net.Sockets.SocketException (10054): An existing connection was forcibly closed by the remote host.
| --- End of inner exception stack trace ---
| at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
| at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
| at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken, Int32 estimatedSize)
| at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
| at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken)
| at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
| at System.Net.Http.Http2Connection.ProcessIncomingFramesAsync()
| --- End of inner exception stack trace ---
| at System.Net.Http.Http2Connection.ThrowRequestAborted(Exception innerException)
| at System.Net.Http.Http2Connection.Http2Stream.CheckResponseBodyState()
| at System.Net.Http.Http2Connection.Http2Stream.TryReadFromBuffer(Span`1 buffer, Boolean partOfSyncRead)
| at System.Net.Http.Http2Connection.Http2Stream.ReadDataAsync(Memory`1 buffer, HttpResponseMessage responseMessage, CancellationToken cancellationToken)
| at k8s.LineSeparatedHttpContent.CancelableStream.ReadAsync(Byte[] buffer, Int32 offset, Int32 count, CancellationToken cancellationToken)
| at System.IO.StreamReader.ReadBufferAsync(CancellationToken cancellationToken)
| at System.IO.StreamReader.ReadLineAsyncInternal(CancellationToken cancellationToken)
| at k8s.Watcher`1.<>c.<CreateWatchEventEnumerator>b__21_1[TR](Task`1 t)
| at System.Threading.Tasks.ContinuationResultTaskFromResultTask`2.InnerInvoke()
| at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)
| --- End of stack trace from previous location ---
| at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)
| at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot, Thread threadPoolThread)
| --- End of stack trace from previous location ---
| at k8s.Watcher`1.CreateWatchEventEnumerator(Func`1 streamReaderCreator, Action`1 onError, CancellationToken cancellationToken)+MoveNext()
| at k8s.Watcher`1.CreateWatchEventEnumerator(Func`1 streamReaderCreator, Action`1 onError, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
| at Aspire.Hosting.Utils.PeriodicRestartAsyncEnumerable.CreateAsync[T](Func`3 enumerableFactory, TimeSpan restartInterval, CancellationToken cancellationToken)+MoveNext() in /_/src/Aspire.Hosting/Utils/PeriodicRestartAsyncEnumerable.cs:line 39
| at Aspire.Hosting.Utils.PeriodicRestartAsyncEnumerable.CreateAsync[T](Func`3 enumerableFactory, TimeSpan restartInterval, CancellationToken cancellationToken)+MoveNext() in /_/src/Aspire.Hosting/Utils/PeriodicRestartAsyncEnumerable.cs:line 59
| at Aspire.Hosting.Utils.PeriodicRestartAsyncEnumerable.CreateAsync[T](Func`3 enumerableFactory, TimeSpan restartInterval, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
| at Aspire.Hosting.Dcp.KubernetesService.WatchAsync[T](String namespaceParameter, CancellationToken cancellationToken)+MoveNext() in /_/src/Aspire.Hosting/Dcp/KubernetesService.cs:line 275
| at Aspire.Hosting.Dcp.KubernetesService.WatchAsync[T](String namespaceParameter, CancellationToken cancellationToken)+MoveNext() in /_/src/Aspire.Hosting/Dcp/KubernetesService.cs:line 275
| at Aspire.Hosting.Dcp.KubernetesService.WatchAsync[T](String namespaceParameter, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
| at Aspire.Hosting.Dcp.DcpExecutor.<>c__DisplayClass54_0.<<CreateServicesAsync>b__1>d.MoveNext() in /_/src/Aspire.Hosting/Dcp/DcpExecutor.cs:line 639
| --- End of stack trace from previous location ---
| at Aspire.Hosting.Dcp.DcpExecutor.<>c__DisplayClass54_0.<<CreateServicesAsync>b__1>d.MoveNext() in /_/src/Aspire.Hosting/Dcp/DcpExecutor.cs:line 639
| --- End of stack trace from previous location ---
| at Polly.ResiliencePipeline.<>c.<<ExecuteAsync>b__3_0>d.MoveNext()
Anyone want to take this one? cc @mitchdenny @danmoseley @RussKie
I'm oversubscribed right now.
In general @radical is getting us to green + a good quarantine system, and fixing obvious cases, but we are heading for a system where dev that owns the test is the same dev that fixes it to get it out of quarantine. (subject to all their other commitments of course)
@karolz-ms have you seen this before
Aspire.Hosting.Dcp.DcpExecutor Debug: Watching for service port allocation ended with an error after 9613.1847 (iteration 0) | System.IO.IOException: The request was aborted.
@danmoseley no but I have a theory why this might have happened (namely, the external bug we fixed recently in the API server libraries).
@radical what happens when a test like this is fixed while this bug is open -- will the system close this bug?
@radical what happens when a test like this is fixed while this bug is open -- will the system close this bug?
That isn't automated right now, so it would be manual.
@karolz-ms have you seen this before
Aspire.Hosting.Dcp.DcpExecutor Debug: Watching for service port allocation ended with an error after 9613.1847 (iteration 0) | System.IO.IOException: The request was aborted.
Another instance - https://dev.azure.com/dnceng-public/public/_build/results?buildId=1031051&view=ms.vss-test-web.build-test-results-tab&runId=27684180&resultId=101861&paneView=attachments
Watching for service port allocation ended with an error after 10001.8571 (iteration 0)