apiserver-network-proxy icon indicating copy to clipboard operation
apiserver-network-proxy copied to clipboard

Published 20 hours ago • verified publisher icon kubernetes-sigs

Flaky Test: TestProxy_LargeResponse

Open tallclair opened this issue 3 years ago • 0 comments
trafficstars

completed 10000 runs in 24m45s with 8 failures (0.08%)

Ran with stress ./tests.test -test.cpu=4 -test.run=TestProxy_LargeResponse

Looks like goroutine leaks:

--- FAIL: TestProxy_LargeResponse (1.48s)
    leaks.go:78: found unexpected goroutines:
        [Goroutine 83 in state select, with sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close on top of the stack:
        goroutine 83 [select]:
        sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close(0xc0004a89b0)
        	/home/stclair/src/github.com/kubernetes-sigs/apiserver-network-proxy/konnectivity-client/pkg/client/conn.go:147 +0x40f
        net/http.(*persistConn).closeLocked(0xc0000c66c0, {0x1550020, 0xc000112c20})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2714 +0x130
        net/http.(*persistConn).close(0xc000103a38?, {0x1550020?, 0xc000112c20?})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2699 +0xb0
        net/http.(*persistConn).readLoop.func1()
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2061 +0x2d
        net/http.(*persistConn).readLoop(0xc0000c66c0)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2236 +0xacc
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1750 +0x173e
        
         Goroutine 84 in state select, with net/http.(*persistConn).writeLoop on top of the stack:
        goroutine 84 [select]:
        net/http.(*persistConn).writeLoop(0xc0000c66c0)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2392 +0xf5
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1751 +0x1791
        ]

--- FAIL: TestProxy_LargeResponse (1.52s)
    leaks.go:78: found unexpected goroutines:
        [Goroutine 79 in state select, with sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close on top of the stack:
        goroutine 79 [select]:
        sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close(0xc00013ea00)
        	/home/stclair/src/github.com/kubernetes-sigs/apiserver-network-proxy/konnectivity-client/pkg/client/conn.go:147 +0x40f
        net/http.(*persistConn).closeLocked(0xc000250fc0, {0x1550020, 0xc000118c20})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2714 +0x130
        net/http.(*persistConn).close(0xc00010f6d8?, {0x1550020?, 0xc000118c20?})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2699 +0xb0
        net/http.(*persistConn).readLoop.func1()
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2061 +0x2d
        net/http.(*persistConn).readLoop(0xc000250fc0)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2236 +0xacc
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1750 +0x173e
        
         Goroutine 80 in state select, with net/http.(*persistConn).writeLoop on top of the stack:
        goroutine 80 [select]:
        net/http.(*persistConn).writeLoop(0xc000250fc0)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2392 +0xf5
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1751 +0x1791
        ]

--- FAIL: TestProxy_LargeResponse (1.54s)
    leaks.go:78: found unexpected goroutines:
        [Goroutine 27 in state select, with sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close on top of the stack:
        goroutine 27 [select]:
        sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close(0xc0000a6820)
        	/home/stclair/src/github.com/kubernetes-sigs/apiserver-network-proxy/konnectivity-client/pkg/client/conn.go:147 +0x40f
        net/http.(*persistConn).closeLocked(0xc0000ecb40, {0x1550020, 0xc000088c50})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2714 +0x130
        net/http.(*persistConn).close(0xc00004fb58?, {0x1550020?, 0xc000088c50?})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2699 +0xb0
        net/http.(*persistConn).readLoop.func1()
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2061 +0x2d
        net/http.(*persistConn).readLoop(0xc0000ecb40)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2236 +0xacc
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1750 +0x173e
        
         Goroutine 28 in state select, with net/http.(*persistConn).writeLoop on top of the stack:
        goroutine 28 [select]:
        net/http.(*persistConn).writeLoop(0xc0000ecb40)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2392 +0xf5
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1751 +0x1791
        ]

--- FAIL: TestProxy_LargeResponse (1.51s)
    leaks.go:78: found unexpected goroutines:
        [Goroutine 85 in state select, with sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close on top of the stack:
        goroutine 85 [select]:
        sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close(0xc0002051d0)
        	/home/stclair/src/github.com/kubernetes-sigs/apiserver-network-proxy/konnectivity-client/pkg/client/conn.go:147 +0x40f
        net/http.(*persistConn).closeLocked(0xc0004257a0, {0x1550020, 0xc000088c30})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2714 +0x130
        net/http.(*persistConn).close(0xc00024b4f8?, {0x1550020?, 0xc000088c30?})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2699 +0xb0
        net/http.(*persistConn).readLoop.func1()
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2061 +0x2d
        net/http.(*persistConn).readLoop(0xc0004257a0)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2236 +0xacc
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1750 +0x173e
        
         Goroutine 86 in state select, with net/http.(*persistConn).writeLoop on top of the stack:
        goroutine 86 [select]:
        net/http.(*persistConn).writeLoop(0xc0004257a0)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2392 +0xf5
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1751 +0x1791
        ]

--- FAIL: TestProxy_LargeResponse (1.55s)
    leaks.go:78: found unexpected goroutines:
        [Goroutine 65 in state select, with sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close on top of the stack:
        goroutine 65 [select]:
        sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close(0xc00012e8c0)
        	/home/stclair/src/github.com/kubernetes-sigs/apiserver-network-proxy/konnectivity-client/pkg/client/conn.go:147 +0x40f
        net/http.(*persistConn).closeLocked(0xc0000ecd80, {0x1550020, 0xc000088c50})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2714 +0x130
        net/http.(*persistConn).close(0xc00004fa98?, {0x1550020?, 0xc000088c50?})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2699 +0xb0
        net/http.(*persistConn).readLoop.func1()
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2061 +0x2d
        net/http.(*persistConn).readLoop(0xc0000ecd80)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2236 +0xacc
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1750 +0x173e
        
         Goroutine 98 in state select, with net/http.(*persistConn).writeLoop on top of the stack:
        goroutine 98 [select]:
        net/http.(*persistConn).writeLoop(0xc0000ecd80)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2392 +0xf5
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1751 +0x1791
        ]

--- FAIL: TestProxy_LargeResponse (1.51s)
    leaks.go:78: found unexpected goroutines:
        [Goroutine 32 in state select, with sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close on top of the stack:
        goroutine 32 [select]:
        sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close(0xc000542550)
        	/home/stclair/src/github.com/kubernetes-sigs/apiserver-network-proxy/konnectivity-client/pkg/client/conn.go:147 +0x40f
        net/http.(*persistConn).closeLocked(0xc00043e5a0, {0x1550020, 0xc000190c20})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2714 +0x130
        net/http.(*persistConn).close(0xc0005404d8?, {0x1550020?, 0xc000190c20?})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2699 +0xb0
        net/http.(*persistConn).readLoop.func1()
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2061 +0x2d
        net/http.(*persistConn).readLoop(0xc00043e5a0)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2236 +0xacc
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1750 +0x173e
        
         Goroutine 33 in state select, with net/http.(*persistConn).writeLoop on top of the stack:
        goroutine 33 [select]:
        net/http.(*persistConn).writeLoop(0xc00043e5a0)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2392 +0xf5
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1751 +0x1791
        ]

--- FAIL: TestProxy_LargeResponse (1.51s)
    leaks.go:78: found unexpected goroutines:
        [Goroutine 71 in state select, with sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close on top of the stack:
        goroutine 71 [select]:
        sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close(0xc0000a60f0)
        	/home/stclair/src/github.com/kubernetes-sigs/apiserver-network-proxy/konnectivity-client/pkg/client/conn.go:147 +0x40f
        net/http.(*persistConn).closeLocked(0xc00049c900, {0x1550020, 0xc000190c20})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2714 +0x130
        net/http.(*persistConn).close(0xc0001646b8?, {0x1550020?, 0xc000190c20?})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2699 +0xb0
        net/http.(*persistConn).readLoop.func1()
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2061 +0x2d
        net/http.(*persistConn).readLoop(0xc00049c900)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2236 +0xacc
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1750 +0x173e
        
         Goroutine 72 in state select, with net/http.(*persistConn).writeLoop on top of the stack:
        goroutine 72 [select]:
        net/http.(*persistConn).writeLoop(0xc00049c900)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2392 +0xf5
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1751 +0x1791
        ]

--- FAIL: TestProxy_LargeResponse (1.50s)
    leaks.go:78: found unexpected goroutines:
        [Goroutine 83 in state select, with sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close on top of the stack:
        goroutine 83 [select]:
        sigs.k8s.io/apiserver-network-proxy/konnectivity-client/pkg/client.(*conn).Close(0xc000112be0)
        	/home/stclair/src/github.com/kubernetes-sigs/apiserver-network-proxy/konnectivity-client/pkg/client/conn.go:147 +0x40f
        net/http.(*persistConn).closeLocked(0xc000427e60, {0x1550020, 0xc000088c50})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2714 +0x130
        net/http.(*persistConn).close(0xc0005c0238?, {0x1550020?, 0xc000088c50?})
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2699 +0xb0
        net/http.(*persistConn).readLoop.func1()
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2061 +0x2d
        net/http.(*persistConn).readLoop(0xc000427e60)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2236 +0xacc
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1750 +0x173e
        
         Goroutine 84 in state select, with net/http.(*persistConn).writeLoop on top of the stack:
        goroutine 84 [select]:
        net/http.(*persistConn).writeLoop(0xc000427e60)
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:2392 +0xf5
        created by net/http.(*Transport).dialConn
        	/home/stclair/sdk/go1.18.1/src/net/http/transport.go:1751 +0x1791
        ]

tallclair avatar Aug 05 '22 17:08 tallclair